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THE  PROBLEM 


•  The  next  war  is  like  to  be  "Come  as  you  are/'  with  little 

TIME  TO  MOBILIZE  AND  TRAIN.  THEREFORE  HIGH  COMBAT  READI¬ 
NESS  IS  CRITICAL. 


o  Yet  we  face  reduced  combat  readiness  and  effectiveness 

CAUSED  BY 

Technological  Changes: 

--More,  and  more  complex  new  weapons  systems  (e.g.. 
Tow,  Dragon,  Roland) 

--More  technology  in  non-combat  activities 

Societal  Changes: 

--The  labor  pool  is  shrinking 

--More  competition  from  business,  industry,  and  wel¬ 
fare 

--High  turnover  of  personnel  in  the  armed  services 
--More  non-english  speakers 

--Fewer  people  who  have  been  successful  academically 

Economic  Changes: 

--Personnel  costs,  equipment  and  ammunition  costs, 

TRAVEL  COSTS,  AND  ECONOMIC  INFLATION  MAKE  REALISTIC 
TRAINING  MORE  DIFFICULT. 

--Training  time  has  been  cut. 

o  Many  approaches  to  these  problems  are  called  for,  but  in 

THE  AREA  OF  TRAINING  AND  JOE  AIDING,  "MORE  OF  THE  SAME" 


IK  MBLEiXCoriioJ 


•  The  current  paper  and  lecture  delivery  system  has  neared  the 

LIMITS  OF  ITS  PRODUCTIVE  CAPACITY. 

— ONE  SYMPTOM:  AN  ENORMOUS  INCREASE  IN  QUANTITY  OF  PRINTED 
MATERIAL. 

--Another  symfton:  updating  a  manual  in  the  field  can 

TAKE  YEARS. 

#  By  ANALOGY ,  THE  CURRENT  NON -INTERACTIVE  PAPER  AND  LECTURE  DELIVERY 
SYSTEM  IS  LIKE  THE  PROPELLER  A I  RPLANE  .  FURTHER  REFINEMENTS  ARE 
POSSIBLE y  BUT  WILL  NOT  PRODUCE  MAJOR  GAINS.  ORDER  OF  MAGNITUDE 
INCREASES  IN  PRODUCTIVITY  ARE  REQUIRED. 

--With  aircraft,  an  entirely  different  approach  to  propulsion  was 

REQUIRED:  THE  JET. 

--With  training  and  jcb  aiding  a  similar  breakthrough  is  required 

INTERACTIVE,  ELECTRONIC  DELIVERY  SYSTEMS. 


THE  OPPORTUNITY 


fl 

•  Hard  Technologies 
--Computer  chips 
—Optical  memories 

—Satellite  and  fiber  optic  commjni cation  networks 

•  Soft  Technologies 

—Comprehensive  teaching  and  learning  models,  based  on  findings 

FROM  NUMEROUS  DISCIPLINES. 

—Increased  understanding  of  the  processes  of  bringing  about 

CHANGE  IN  ORGANIZATIONS. 

•  With  actual  equipment  costs  increasing,  electronic 

DELIVERY  SYSTEM  COSTS  FOR  TRAINING  AND  JOB  AIDING  MAY 
BE  NEGLIGIBLE. 

•  Availability  of  electronics  and  software  utilities  for 

TRAINING  IS  REACHING  THE  TAKEOFF  STAGE,  WHERE  ONE 
DEVELOPMENT  FUELS  THE  NEXT. 


18jC  Time  198C 


PURPOSE  OF  THIS  STUDY 


Qualitatively  analyze  the  cost/effectiveness  for 

ELECTRONIC  DELIVERY  SYSTEMS  OF: 


o  Color,  shading,  and  gray  scale 


•  [notion 


•  Sound 


#  Image  quality 


•  Interaction 


«  Othe-  presentation  features 


Use  information  about 

RESPONSE  ALTERNATIVES 


THESE  features  to  recommend  display  and 
FOR  COf-TIUNICATIVE  ELECTRONIC  delivery 


SY5TE 


I  »w 


CRITERIA  FOR 

ELECTRONIC  DELIVERY  SYSTEMS 


EFFECTIVE 

•  User  comprehension  of  presented  information 
a  Rate  of  comprehension 

o  Retention 

o  User  acceptance  and  motivation 

LOW  COST 

0  Hardware  acquisition 

o  Hardware  ownership  (reliability,  availability, 
maintainability) 

•  Software  and  courseware  development 

•  Software  and  courseware  update  and  revision 

HIGH  BENEFITS 

•  Simplicity  of  use 

9  Compatibility  with  existing  delivery  systems 
(e.g. ,  print  and  cue/see) 

9  Small  size 

9  Rugged 

9  Modular,  plug  compatible  components 

Rapidly  expandable,  easily  replicated  for  fast 
response  to  mobilization 
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THE  APPROACH  JJSEI 


•  Define  how  the  systems  will  be  used  (scenarios) 


a  Define  a  candidate  family  of  delivery  systems  with  modular  components 

TO  MEET  THESE  USAGE  REQUIREMENTS 


O 


Using  existing  research  and  new  experiments,  determine 

NESS  AND  OTHER  BENEFITS  OF  CANDIDATE  FEATURES 


EFFECTIVE- 


o  Estimate  costs  for  quantity  purchases  in  1985  to  obtain  different 

FEATURES.  EXAMINE  COST  BENEFIT  TRADEOFFS  AND  RECOMMEND  A  SET  OF 
PREFERRED  FEATURES  AND  A  SET  OF  LOWEST  FEASIBLE  COST  FEATURES  FOR 
EACH  TYPE  OF  SYSTEM 


Make  recommendations  for  features  in  the  context  of  actua.  alternative 


DISPLAY  AND  RESPONSE  COMPONENTS 


THE  GOAL  AND  SOKE  CONSTRAINTS 


o  Specify  stand-alone  electronic  delivery  systems  for  trainhc- 

MATE RIALS  A' ID  JOB  PERFORMANCE  AIDS 


Use  video  and  computer  technology  (power  of  both  th 

AUDI O/VI SUAL  AND  COMPUTER  TRADITIONS) 


o  Anticipate  high  density  in  the  Army 

0  Low  UNIT  COST  IS  A  MAJOR  DRIVER  OF  THE  DESIGN 


0  Maximum  effectiveness  required  for  instruction  and 

JOB  AIDING 


o 


User  interface  must  be  excellent 


HOW  THE  SYSTEMS  WILL  BE  USED 


4* 


1.  On  the  Job  Training: 

•  Training  Extension  Course  (TEC)  lessons 

•  Skill  Qualification  Tests  (SQT) 

o  Army  Training  and  Evaluation  Program  (ARTEP) 

0  Job  Training  Packages  (JTP) 

2.  Skill  Performance  Aids  (SPA) 

3.  TRADOC  Schools  (including  simulation) 

A.  Recruiting 

5.  Armed  Forces  Entrance  and  Examination  Stations(AFEES) 

6,  Electronic  offices 


When  analyzed,  the  uses  required  five  major  types  of 

SYSTEMS  FOR: 

•  Instruction  in  a  sheltered  environment 

•  Command  Management  and  Administration  in  a  sheltered 

ENVIRONMENT 

•  Job  Aids  in  the  field 
o  Author i ng 

0  Rating  and  Inventory  using  a  hand  held  device  in  the  fie^d 
These  can  be  supported  by  on-site  utilities  like  a  printer, 

HIGH  CACAC1TY  SHADED  MEMORY,  AND  MODEMS. 
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EFFECTIVENESS  AND  OTHER  BENEFITS.  OF  CANDIDATE  FEATURES 


COLOR,  SHADING,  AND  GRAY  SCALE 

•  Color  can  increase  both  immediate  performance  and  retention  in 

COMPARISON  TO  A  MONOCHROME  PRESENTATION  , 

•  Learners  appear  to  take  more  time  assimilating  color  informati on 

THAN  MONOCHROME. 

•  The  .above  MAY  explain  why  available  research  indicates  THAT  COLOR 

HAS  NO  CONSISTENT  EFFECT  ACROSS  ALL  LEARNING  SITUATIONS:  COLOR 
IS  BETTER  FOR  SELF-PACED  MATERIALS  BUT  NOT  FOR  FIXED  PACED,  FOR 
STILLS  BUT  NOT  FOR  MOTION,  AND  FOR  HI C3H  APTITUDE  LEARNERS  BUT  NOT 
FOR  LOW  APTITUDE. 

— LEARNERS  MUST  BE  GIVEN  SUFFICIENT  TIME  TO  ASSIMILATE  COLOR.  If 
THEY  ARE,  PERFORMANCE  IS  USUALLY  BETTER  THAN'  WITH  MONOCHROME, 
THEY  ARE  NOT  GIVEN  SUFFICIENT  TIME,  PERFORMANCE  APPEARS  TO  EE 
WORSE . 

— Overall,  the  rate  of  achievement  gain  over  time  is  equivalent 

BETWEEN  COLOR  AND  MONOCHROME. 

•  Color  is  required  when  the  task  demands  color  discriminations, 

•  Color  coding  is  very  productive  for  highlighting  and  distinguish::; 

PORTION'S  O-  DISPLAYS  (E.G.  ONE  LEVEL  OF  DEPTH  IN  A  3d  GRAPHIC) 

OR  TYPE  Oc  CONTENT  (E.G.,  A  SET  OF  RULES). 
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EFFECT  I VQ  iE  SS  A'P  jyRIFD  BdcEUS  OF  CAOIDATt  FEWR3  (Co-.td.A 
•  Color  video  capability  permits  use  of  existing  color  materials, 

USUALLY  WITHOUT  REFORMATTING  (E.G.,  TEC,  ETV) . 

0  rbST  STUDENTS  TODAY  EXPECT  COLOR  AND  PREFER  IT  OVER  MONOCHROME  . 

IT  MAY  THUS  HAVE  A  MOTIVATIONAL  ADVANTAGE  WHICH  CAN  DECREASE  ATTRITION, 

o  For  sda's,  existing  printed  materials  can  be  reformatted  with  co 

P  LTTE  R"  GENE  RATED  ALPHANUMER  I  CS  AND  LINE  GRAPHICS.  FUTURE  SPA'S 
CAN  BE  PRODUCED  INITIALLY  THIS  WAY,  USING  COMPUTER  DESIGN 
AND  EDITING  AIDS. 


o  If  GRAY  SCALE  IS  USED  IN  COMPUTER  GENERATED  DISDLAYS,  FOUR  LEVELS 
ARE  THE  MOST  REQUIRED,  AND  USUALLY  TWO  OR  THREE  LEVELS  WILL  SU-FI CE . 
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MOTION 


:a  , 


O  I  HE  AVAI LABLE  RESEARCH  STUDIES  INDICATE  THAT  THE  EFFECT  OF  MOTION 
DEPENDS  ON  THE  PURPOSE,  THE  CONTENT,  AND  OTHER  FACTORS. 


9  Procedures  involving  a  critical  demonstration  of  action's  over  time 

ARE  BEST  PRESENTED  WITH  MOTION.  SPATIAL  CONCEPTS  ARE  BEST  PRESENTED 
WITH  STILLS. 


o  Human  modeling  to  change  actitudes  often  requires  motion. 


o  Mot i of.  capability  permits  use  of  existing  motion  materials.  It 

IS  EASY  TO  TRANSFER  FROM  16  MM  FILM  OR  FROM,  VIDEO  TO  VIDEODISC. 


•  i'CTI ON  SEQUENCES  TYPICALLY  DC  NOT  ALLOW  SELF  PACING.  CARE  MUST  BE 
TAKEN  NOT  TO  PRESENT  INFORMATION  SO  FAST  THAT  THE  LEARNER 
CANNOT  PROCESS  IT  WELL.  SPEED  SHOULD  BE  SLOWED  DOWN  OR 
UNDER  USER  CONTROL  TO  DEMONSTRATE  MOTOR  SKILLS. 


•  A  HIGH  PROPORTION  OF  MOTION  IN  EXISTING  FILMS  IS  NON-RE  LEVANT  (STILLS ) . 


•  oTI LLS  with  audio  ARE  OFTEN  AS  EFFECTIVE  AS  MOTION  WITH  AUDI C . 


ANIMATED  GRAPHICS  CAN  HELP  TO  VISUALIZE  AND  CLARIFY  PRO¬ 
CESSES  OF  MANY  KINDS,  AND  ACT  ESPECIALLY  USEFUL  IN  SIMULA! I 
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REALISM 


Realism  must  be  matched  to  the  learner's  experience. 

--The  learner  who  is  new  to  a  subject  needs  simplified 

PRESENTATIONS  (E.G.,  LINE  DRAWINGS).  MORE  EXPERIENCED 
INDIVIDUALS  NEED  A  REPLICA  OF  THE  COMPLEXITY  OF  THE 
ACTUAL  SITUATION. 

--Optimal  realism  may  change  as  the  learner  grows  more 

PROFICIENT. 

--TOO  MUCH  DETAIL  AT  FIRST  CAN  IMPEDE  LEARNING  BY  OBSCURING 
THE  CRITICAL  POINTS. 

--TOO  LITTLE  DETAIL  FOR  PERSONS  EXPERIENCED  IN  THE  CONTENT 
MAY  NOT  GIVE  THEM  REAL  WORLD  EXPERIENCE  IN  FINDING  THE 
CRITICAL  FEATURES  ON  THEIR  OWN. 


a  Realism  must  be  matched  to  the  method  of  presentation. 
--Students  need  time  to  process  complex  visuals. 

--Realistic  drawings  and  photographs  are  most  effective 

FOR  SELF  PACED  INSTRUCTION  (LIKE  THAT  AVAILABLE  ON 
ELECTRONIC  DELIVERY  SYSTEMS),  WHERE  THE  STUDENT  CAN  STUDY 
THE  MATERIALS  AS  LONG  AS  NEEDED. 

--Simple  line  drawings  are  best  for  externally  paced 

INSTRUCTION  (LIKE  VIDEOTAPE),  WHERE  SUFFICIENT  TIME  MAN 
NOT  BE  AVAILABLE  FOR  ALL  STUDENTS  TO  PROCESS  THE  INFORMAT  1 01 


The  FUNCTIONALITY  OF  THE  PRESENTATION,  NOT  ITS  REPLICA 


NATURE  IS  WHAT  COUNTS. 


» 


REALISM  (Contd.) 

6  A  SEQUENCE  OF  INCREASINGLY  REALISTIC/  COMPLEX/  OR  DIFFICULT 
EXPERIENCES  MAY  BE  OPTIMAL. 

--AN  EXAMPLE  IS  USE  OF  THE  GRADUATED  LENGTH  METHOD  IN 
SKIING/  WHERE  THE  LEARNER  PROGRESSES  FROM  SIMPLE  TO  USE 
SHORT  SKIS  TO  REGULAR  LENGTH  SKIS  AND  STEE-ER  HILLS. 

O  PICTORIAL  REALISM  WITH  COLOR  AND  MOTION  IS  USUALLY  PRE¬ 
FERRED  BY  STUDENTS. 

O  PICTURES  CAN  FACILITATE  LEARNING  FROM  TEXT. 

•  Multimedia  presentations  may  reduce  attrition  by  main¬ 
taining  STUDENT  INTEREST, 

--Caution:  A  motivational  learning  experience  followed 

BY  A  BORING  JOB  WILL  NOT  REDUCE  TURNOVER. 


L7it  QUALITY  -  "GRAIN INESS' 


Character  resolution  -  10  to  12  TV  scan  lines  per 

CHARACTER.  FOR  TECHNICAL  MANUALS  THE  US  BROADCAST 
STANDARD  IS  1 NSUFFI ECI ENT  AS  INVESTIGATED  IN  EXPERI¬ 
MENT  3  OF  THIS  STUDY.  IN  EXPERIMENT  4  WE  FOUND  THA^ 
AROUND  945  SCAN  LINES  ARE  REQUIRED  AT  20  MHZ  (BLACK 

AND  WHITE)  TO  PRESENT  A  FULL  PAGE  OF  TEXT  AND  GRAPHICS 
ON  THE  SCREEN.  THE  US  BROADCAST  STANDARD  IS  525  SCAN 
LINES  WITH  APPROXIMATELY  4.2  MHZ.  USING  THE  US  STAND¬ 
ARD,  12  LINES  OF  30  CHARACTERS  IS  PREFERRED,  THOUGH 
MORE  CAN  BE  PUT  ON  THE  SCREEN. 

Viewing  Distance  -  usually  28  to  38  inches  is  pre¬ 
ferred,  The  viewer  must  be  within  touching  distance 
(about  21  inches)  IF  A  touch  screen  is  used. 

Gray  scale  levels  -  four  levels  of  gray  is  the  most 
that  is  usually  needed  and  2  or  3  levels  are  adequate 
for  alphanumerics  and  many  graphics. 

Character  size  -  approximately  .2  inch  per  character, 
viewed  AT  28  INCHES  (=15  TO  30  MIN.  of  arc).  Characte 
SIZE  SHOULD  EE  DETERMINED  BY  CONTENT  BEYOND  THIS  BASIC 


I  WAGE  QUALITY  -  "GRAININESS"  (comp.) 

•  Font  -  no  established  superiority  of  any  font  for  CRT's, 
but  Lincoln/Mi tre,  Mil-M-10812,  and  leroy  fonts  are  all 
acceptable.  On  a  video  display  a  studio  quality  character 

GENERATOR  CAN  PRODUCE  A  VERY  WIDE  VARIETY  OF  FONTS  TO 
MATCH  THE  CONTENT  AND  STYLE. 

0  DOT  MATRIX  SIZE  OF  CRT  CHARACTERS  -  5x7  DOTS  MINIMUM, 

7x9  PREFERRED  FOR  EACH  CHARACTER, 

•  COLOR  OF  MONOCHROME  DISPLAY  -  IS  NOT  A  MAJOR  FACTOR. 
Black/white,  YELLOW,  GREEN  ARE  ALL  ACCEPTABLE. 

•  UPPER  CASE  VS.  UPPER  AND  LOWER  CASE  -  DATA  FOR  CRT'S 
IS  THIN,  BUT  MIXED  UPPER  AND  LOWER  CASE  IS  BETTER  FOR 
PRINTED  TEXT  OF  LENGTHY  PASSAGES. 


S-IS 


.« 


IMAGE  QUALITY  -  VISUAL  ELEMENTS 


Meaningfulness  of  visual  elements  is  more  important 

THAN  REALISM--HAND  SKETCHED  LINE  DRAWINGS  WHICH  HIGH¬ 
LIGHT  CRITICAL  POINTS  CAN  BE  AS  EFFECTIVE  AS  DETAILED 
COLORED  PICTURES. 


For  procedural  instruction,  text  plus  illustrations 

IS  BETTER  THAN  EITHER  BV  ITSELF. 


o  Users  differ  in  visual  literacy.  Complex  charts  and 

GRAPHS  REQUIRE  MORE  EXPERIENCE  THAN  SIMPLE  PICTURES, 
SO  VISUAL  ELEMENTS  MUST  BE  MATCHED  TO  USER  ABILITIES 
AND  EXPERIENCE. 

•  Experiment  1  in  this  study  found  that  line  drawings 

YIELDED  RESULTS  EQUAL  TO  PHOTOGRAPHS,  NOT  ONLY  FOR 
PAPER  AND  PENCIL  TESTS,  BUT  ALSO  FOR  JOB  PERFORMANCE 
TESTS. 
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SOUND  PRESENTATIONS 


o  Realistic  voice  or  other  sounds  are  required  for  many 

KINDS  OF  MODELING,  WHERE  THE  OBJECTIVE  IS  TO  CHANGE 
ATTITUDES  OR  ILLUSTRATE  A  PROCEDURE  BY  PRESENTING  AN 
EXPERT. 


a  Sounds  are  required  to  make  certain  discriminations 
(e.g.,  between  a  motor  running  smoothly  or  roughly). 


9  Non-voice  sounds  (e.g.,  penny  arcade  games)  can  add 
excitement  and  motivation  to  simulations. 


•  Synthesized  and  digitized  speech  varies  widely  in 

QUALITY.  LOW  QUALITY  IS  APPROPRIATE  FOR  CUEING  AND 
PRESENTING  WORDS  IN  CONTEXT  (SINCE  A  WORD  IN  A  PHRASE  IS 
EASIER  TO  UNDERSTAND  THAN  A  WORD  IN  ISOLATION).  HIGHER 
QUALITY  IS  REQUIRED  FOR  ISOLATED  WORDS  OR  WHERE  UNDER¬ 
STANDING  IS  CRITICAL. 

•  Permits  communication  when  the  user  is  away  from  the 

TERMINAL  OR  LOOKING  ELSEWHERE  (E.G.,  AT  A  SIMULATOR  OR 
WHILE  FIXING  SOMETHING). 

o  Audio  is  helpful  to  poor  readers,  and  audio  redundant 

WITH  TEXT  IS  PREFERRED  BY  SOME  WHO  CAN  READ. 

o  Extensive  voice  presentation  slows  down  and  faces  the 
man/machine  interaction.  This  may  or  may  not  be  helpfu^. 
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INTERACTION  -  PROCESSES 


The  bulk  of  electronic  delivery  systems  interactions  for 

MOST  APPLICATIONS  CONSISTS  OF  A  SIMPLE  PROMPT  OR  QUESTION 
AND  A  STUDENT  RESPONSE. 

An  ENORMOUS  VARIETY  OF  INTERACTIONS,  FROM  SIMPLE  MENU  AND 
MULTIPLE -CHOICE  BRANCHING  TO  FAIRLY  COMPLEX  INFORMATION 
SEARCHES,  JOB  AIDS,  GAMES,  AND  SIMULATIONS  CAN  BE  PROG RAM'-'ED 
FROM  A  LIMITED,  SIMPLE  SET  OF  COMMANDS  AND  DATA  STRUCTURES. 

AS  THE  PROGRAM  BECOMES  MORE  ART  1 F I CALLY  INTELLIGENT,  FOUR 
ELEMENTS  BECOME  MORE  SOPHI ST  I CATED : 

--AN  INTERACTIVE  MODEL  OF  THE  CONTENT  BEING  TAUGHT 
(E.G.,  A  PIECE  OF  EQUIPMENT  BEING  SIMULATED) 

--A  MODEL  OF  AN  EXPERT  WHO  OPERATES  THE  SYSTEM  (E.G.,  A 
PROCEDURE  FOR  SOLVING  A  PROBLEM) 

--A  MODEL  OF  EACH  STUDENT  (RANGES  FROM  A  HISTORY  OF  STUDENT'S 
KEYPRESSES  TO  A  SOPHISTICATED  MODEL  OF  SPECIFIC  SKILLS) 

--AN  ADVISOR  TO  MAKE  COMMENTS  OR  PRESENT  PROBLEMS  THAT 
WILL  MOVE  THE  STUDENT  PERFORMANCE  CLOSER  TO  THAT  OF  THE 
EXPERT 

IN  A  CLASSROOM,  THE  SUBJECT  MATTER  IS  THE  CONTENT  MODEL;  THE 
TEXT,  OR  TECHNICAL  MANUAL  HOLDS  THE  EXPERT  MODEL;  THE 
INSTRUCTOR  IS  BOTH  AN  EXPERT  AND  THE  ADVISOR;  AND  THE 
GRADE  BOOK  CONTAINS  THE  STUDENT  MODEL.  THE  VIDEO  MATERIALS 
AND  COMPUTER  PROGRAM  CAN  SERVE  ALL  OF  THESE  FUNCTIONS  IN 
AN  ELECTRONIC  DELIVERY  SYSTEM,  AT  DIFFERENT  LEVELS  OF  COST 
AND  SOPHISTICATION. 

The  data  from  Experiment  2  of  this  study  suggests  that  joe 

AIDS  MAY  YIELD  ACCURACY  AND  TIME  RESULTS  EQUIVALENT  TO  0= 
BETTER  THAN  SEPARATE  INSTRUCTION  FOLLOWED  BY  ACCESS  TO 
TECHNICAL  MANUALS.  SIMPLICITY  CAN  THUS  YIELD  MAJO- 
BENEFITS. 
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INTERACTION  -  PROCESSES  (contd.) 


•  An  electronic  delivery  system  may  be  used  in  several 

INTERACTION  MODES: 

:■■■  (1)  Presentation  Node 

-  •  --Allows  non- interactive  pages  of  text  or  motion 

2  segments  to  be  presented  with  accompanying  audio 

or  illustrations  in  any  combination. 

--The  user  controls  rate  and  sometimes  sequence. 

--Essentially  this  is  a  page  turning  mode  which  man- 
present  AN  EXPERT  PROCEDURE. 


(2)  Exercise  Mode 

--Users  respond  to  stored  questions  or  problems, 

AND  RECEIVE  IMMEDIATE  FEEDBACK. 

--Branching  depends  on  the  answers. 

--Without  two  screens  or  text/graphics  overlay,  most 
videodisc  systems  stop  with  this  mode. 

--The  expert,  student  model,  and  advisor  functions 

MAY  BE  INCLUDED. 

--Some  simulations  for  fixed  sequence  procedures  use 

THIS  MODE,  SINCE  THEY  ARE  JUST  A  FIXED  SEQUENCE  OF 
ACTIONS , 

(3)  6  £.‘I£RAI  LY  E_S  1  DlULALLQjL  Tk'D  E 

--Introduces  a  partial  model  of  the  system,  which 
permits  new  items  to  be  generated. 

--Provides  realistic  exercise  of  concepts  and  rules  while 
maintaining  test  integrity  (since  evaluation  typically 
occurs  with  unique  exemplars). 
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lNItRACI10:{  .-..PROCESSES  > 


--Examples  are  (a)  generation  of  mathematics  problem 

FOR  DRILL  IN  ADDITION  AND  SUBTRACTION  OR  (&)  ELECT 
EQUIPMENT  TROUBLESHOOTING  TRAINERS. 

--User  interactions  can  be  more  extensive,  since  new 

EXERCISES  CAN  BE  PRODUCED  TO  FIT  I NDI VI  D'JA.  NEEDS  . 

The  expert,  student  model,  and  advisor  functions  ; 

ALL  BE  INCLUDED. 

9  In  EXERCISE  AND  GENERATIVE  MODES,  STUDENT  INTERACTIONS 
CAN  BECOME  COMP LEX- -RANG I NG  FROM  ENTERING  DATA  TO  FLYING 
A  SIMULATED  AIRCRAFT. 
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INTERACTION  -  MECHANISMS 


•  A  HIGH  PROPORTION  OF  POTENTIAL  USERS  OF  ELECTRONIC 
DELIVERY  SYSTEMS  DO  NOT  TYPE  WELL. 

o  Standard  Alphanumeric  Keyboards 

--Good  for  typists  where  a  high  volume  of  alfhanumeri cs 

MUST  BE  ENTERED. 

--Not  efficient  for  most  soldiers  and  NCO's. 
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•  Keypads 

--More  efficient  than  keyboards  for  many  training 
applications. 

--Can  be  very  inexpensive,  but  must  usually  be  configured 
for  a  specific  application. 

--They  limit  the  type  of  responses  which  can  be  entered 
and  make  non-numeric  problems  into  multiple  choice, 

SINCE  ALL  THE  POSSIBLE  RESPONSES  ARE  DISPLAYED  ON  THE 
KEYPAD. 


--IF  USED  TO  SELECT  AMONG  FUNCTIONS  (E.G.,  NEXT)  WHERE 
ANOTHER  DEVICE  (E.G.,  A  MOUSE)  IS  USED  FOR  INPUTTING 
RESPONSES,  THEY  CAN  BE  VERY  EFFICIENT.  ^ 


INTERACTION  -  MECHANISMS  (CONTD.) 


•  Touch  Panels 

--Natural,  no  training  required, 

--Can  alter  the  response  choices,  by  changing  displays 

ON  THE  SCREEN. 

--User  must  be  closer  than  is  normally  preferred,  and 

REPEATED  REACHING  UP  TO  TOUCH  CAN  BE  TIRING. 

--Preferred  over  less  reliable  light  pens,  which  require 

A  BRIGHT  SPC'r  AS  A  TARGET. 


•  Joy  Sticks 

--Inexpensive  and  frequently  used. 

--Provides  functions  of  touch  panels,  plus  some  additional 
functions . 

--Allows  cursor  movement  and  positioning  on  screen. 
Function  button  or  key  pad  needed  to  indicate  choice, 

--Inferior  to  trackball  or  mouse  for  continuous  cursor 
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MERACIIQIL jLJSECHAfllSMS  (  contd  . ) 

•  Irackballs. 

--More  expensive  than  joystick. 

--Allows  infinite  motion  by  continuing  to  turn  the  ball 
--Needs  function  key.  i - - — - ~  ^ _ 


f’iOIJRC  ANT.  hDAC>4irc  IfiRil 


Can  move  cursor  on  screen  with  one  hand. 

Like  a  touch  panel  taken  off  the  screen. 

Needs  function  key  or  keys. 

Avoids  fatigue  of  reaching  for  screen,  but  require 

A  LITTLE  EXPERIENCE. 

Graphics  tablet  used  for  h! gn  resolution  digitizin 
graphics,  while  mouse  provides  rapid  cursor  positi 

FOR  INTERACTIONS. 


INTERACTION  -  MECHANISMS  (contd.) 


I 


> 

r 


a 


o  Voice  Input 

--Used  where  hands  or  eves  are  busy  (e.g.,  for  maintenance 
aiding) , 

--A  NATURAL  MEANS  OF  COMMUNICATION  FOR  NON-TYPIST  SOLDIERS. 

--Avoids  typing.  High  quality  units  are  more  accurate 

THAN  TYPING  ONCE  THE  SYSTEM  HAS  LEARNED  THE  USER'S 
VOICE. 

--Permits  mobility. 

--Good  quality  units  are  still  expensive,  but  should 

DECREASE  IN  PRICE  BY  1985. 

--Disadvantages:  A  brief  pause  must  separate  each  word 
or  item.  Each  user  must  train  the  system  for  each 
utterance  to  be  recognized.  Can  be  more  tiring  than 

TYPING  FOR  HIGH  VOLUMES  Or  DATA  ENTRY. 

--Since  alternatives  need  not  be  presented  on  a  screen  c- 

PAD,  VOICE  INPUT  DOES  NOT  LIMIT  INTERACTIONS  TO  MULTIPLE 
CHOICE.  It  IS  THUS  MORE  FLEXIBLE  THAN  KEYPADS  OR  TOUCH 
SCREE’  . 
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•  Start  with  1981  high  volume  (5,000  units)  original 
equipment  Manufacturer  (OEM)  price  where  one  is  known. 

•  Determine  range  of  projected  prices  in  1985  by  applying 

AN  EXPERIENCE  CURVE  BASED  ON  THE  TYPE  OF  TECHNOLOGY  AND 
THE  CURRENT  AND  PROJECTED  SALES  VOLUME.  CONVERT  THIS  TO 
PROJECTED  YEARLY  DECREASES  IN  COST.  GENERALLY  AS 
CUMULATIVE  VOLUME  DOUBLES,  PRICE  IN  REAL  TERMS  IS  CUT  BY 
20  TO  30  PERCENT. 

•  Select  the  probable  price  within  the  range  by  interviewing 
experts.  This  yields  a  rough  price  estimate. 

o  These  prices  are  suggestive  of  component  prices  only. 

In  some  cases  (e.g.,  keyboards)  the  components  simply 
plug  in  to  the  basic  system.  In  other  cases  (e.g.,  touch 
panels)  programming  may  be  required.  Costs  of  integration, 
checkout,  delivery,  etc.  might  average  20  percent  per 
system. 


.« 


•  Projected  prices  are  in  terms  of  1981  dollars,  Thus 

inflation  must  be  added  to  these  figures  to  arrive  at 

nominal  1985  prices.  The  figures  presented  here  are  simply 
discussion  points.  The  Technical  Data  Base  Correlation 
study  will  review  and  refine  these  figures. 
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A,  Instruction  i n  a  Sheltered  Environment 

Response 


projected 
PftKE  .id  . 


Keypad- 

AND  ToUCh  PAN: 


lotion; 


n 


1  it  r  b 


HIGH  QUALITY  VI 
CP  KEYBOARD 

OR  LOW  RESOLUTION  JOYSTICK 
OR  LOW  RESOLUTION  MOUSE 

Valuator  u,g.. 


OR  _ ... 

or  Trackball 


RriECST  AT ) 


r\  \  _/ 


13"  FnEC  .  RESOLUTION  ( E  .  G  .  , 


<  A' 

$  2: 


tuLlOiL  P  I  X E  _  i  COLOR 

'ST  vieej  ca~  ae : l i t y 

NTSC  INDUSTRIAL  VIDEODISC  F.:^- 

r  ~  c  •''r*  ’I-  ''1  o • "  v 


$3; 


c.  830 


Videodisc  interfa.: 

OR  LOW  TO  MEDIU'-'  PESC_UTICN  (E.G.,  JJJX’Ajj  PIXELS- 
MONOCHROME  TE-MINA_  WITH  TEXT /GRAPH! OS 

Options 


Projection  system  fc: 
CO  i_Or 


!'TC 

J 


0-  J! G I T i ZED  RANI 


ces; 


c  *>' - 

c  c  -  ' 


Video 


NTSC  JSA  BROADCAST  STANZA: 


A . »  1 1  „  ;  ti  X  t  / : 


T  LHrt  r\  v 
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A.  Instruction  In  A  Sheltered  Envif.cnmei 


Preferred 

32  bit  CPU 
256k  RA,v, 

1/A  SHARE  OF 
30  MBYTE  DISK/TAPE 
keypad 
Touch  =an~_ 

512x512  Color 

GRAPH  1 CS/TERM ! N . 
WJ.TH  NTSC  VIDEO 
NTSl  VDISC  PLAYER 
V'DISC  CONTROLLER 


$  520 
292 


Integration  etc 

(20%; 


800 

100 

5425 

1085 

$6510 


•>. y  Cost  Video 


It  e:t  CPU 

0  “  "  .  r  •  V 


L  \br-. 
Keypad. 


:mto= 


NTSC  Videodisc 
player 

NTSC  char,  gen 

VDISC  CONTROLLER 


800 

200 

J00 

2375 


Integration  (20%)  475 

$285C 


A'  1  DIGITAL  Or ~_I. 


32  BIT  CPi  5  52, 

256-:  RAV  2u. 

1/4  OF  32  LB.TE  650 

DIS.k/TAPE  -- 

Key fa:  U 

T-  i  T  S'1 

OjOaiJL  MONC  Cn.-.w'': 

GRAPHICS  TERM  IN..  10^ 

2525 


i  \  »  L  J  ^ 


505 

$3030 
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E.  Administration/  ina 


•J  Management  In  A  Sheltered  Environ—:. 


Preferred 


32„bit  CPU  S  520 
255K  Ram 

1/4  SHARE  0"  39  b'JJ 
Mbyte  disk/tape 
Keyeqa-e  -tv 

512x512  co -Or. 

TERM  I  ~  - 

44  5j 

i 89  c 

I  i .  ,  I  I 

(2u>;;  TTSTT 

$DD/  C 


16  BIT  CPU 
255k  R.v. 

2  Mbyte  Floppy 

Kevboare 

32 0x24 j  mcnoe-r 


1  •  .t  r  r.~  ’  7  ’  '■  • 
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C,  Job  Aiding  In  The  Fie.d 

ELS-JRj 


EB£££S5JEJQ 


1  LI  TAR ! ZED  KEYPAD 


QeIISuiA 


ft*  r  I  t  t  r?  7 
I  ■  !  w  i  I  MPl  i 


[•’i  LI  TAR  1 
I  L I  T  A  R 


:d  ke>f:ar: 

II:  !  0  j  Gh F  A.  A  z.  ~ 

■  I  h  I  G  A  L  _  A  _ T  -i 


r, . 

ULi- 


r.r.- . 


i'l  I  L  i  T  A  r.  I  _  - 


is  i  r\  i  i  m  1 1  «  i. 


in . 


D.  Authoring 


Projected 
PHIjCE  in. 


1 


Keyboard 

$ 

70 

AND 

Hi  resolution  graphics  tablet 

$ 

450 

AND 

Keypad 

$ 

15 

AND 

Touch  panel 

$ 

50 

AND 

Valuator 

c 

20 

O'TLCDii 

High  quality  voice  input 

c 

V 

850 

h:  RESOLUTION  JCYSTICr. 

V 

/  ;  1 

Hi  RESOLUTION  TRACKBALL. 

$ 
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'•‘.ED  RESOLUTION  (d12x5l2  PIXELS)  CCLOP 
TEXT/GRA=H1 CS  TERM  I  NA._  WITH  N i SC  VIDEO 
AND  NTSC  INDUSTRIAL  VIDEODISC  PLAYER 
and  Studio  quality  cOlGF.  text/gra Pnics 
CHARACTER  GENERATOR 
AND  3/4"  VIDEOTAPE  EDITOR 


AD-J. 


S  800 
RAT  00" 

$5000 


Digitized  random  access  voice  output 


S  650 


.OW  TO  MEDIUM  RESOLUTION  ( E  .  G  .  300x400  PIXELS)  $1) 
MONOCHROME  MONITOR  WITH  TEXT/GRAPH  I CS 


Text/graphics  editor: 
Authoring  system  rrotdt >fes 

LESSONS  EY  "FILLING  IN  TH 
hU T HO R  Mm N.-n l l Ml  N  ,  S  Y  i  ;  l 1  l 
PRODUCTION  AND  SCr-.EDJ_EC  ■ 
Data  ease  management  system 

TC  EVALUATION  DATA 
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Cost  Summary 


D.  Authoring 

Er£££B££I> 

32  bit  CPU 

S  520 

256k  RAM 

29  D 

Keyboard 

70 

Hi  resolution  graphics 

A50 

tablet 

15 

Keypad 

Touch  Panel 

50 

Valuator 

20 

Medium  resolution 
(512x512  pixels) 

3000 

Color  graphics  term¬ 
inal  w/NTSC  vi dec 

NTSC  I NDUSTR I A_ 

800 

VIDEODISC  PLAYER 

Videodisc  control  inter 

FACE 

-  100 

$5315 

Integration  (202/ 

1053 

$6378 

All  Digital 

32, bit  CPU  $ 

256k  RA. , 

Keyboard 

Hi  Resolution  graphics 

TABLET 

Keypad 
Touch  Pa:j e l. 

Valuator 

Low  to  medium  resolution 
(e.g.,  30QxA09  1 

pixels)  monochrome 
monitor  w/text/grapkics 


Integration'  (2ul.- 


Studio  quality  color  text/graphics 
character  generator  $6D> OOj 

3/A"  videotape  editor  3,500 
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Rating  and  Inventory  in  the  fi e ld  JHand_ He ld_ Data 

ENTRY  DEVICE)  ~ . . 


ElSp_0Ji5£ 


Projected  p 
Price  in  19 


Militarized  Keypad 


Militarized  small  flat  panel  (2  ro-.-.s  of  92 

CHARS:  PRICE  IS  EXTREMELY  SENSITIVE  TP 
NUMBER  OF  DISPLAY  CHARACTERS ) 


S  90 


PROCES: 


>TOR  V<~.: 


P-RZE.ZSiLZP 


8  BIT  BATTERY  POWERED  Crw 

5>  100 

16k  nonvolatile  Raw 

$  50 

2K  ROM 

$  10 

mackaging  and  Power  Supply 

S  50 

$  320 

Integration  (20% > 

£  F>~ 

$  389 
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CONCLUSIONS  AND  RECOMMENDATIONS 
FOR  JOB  TRAINING 

•  Visual  displays  can  use  standard  broadcast  color  tv  if 
it  includes  computer  text  and  graphics.  Reformatting  is 
required  for  printed  text,  but  yields  benefits  in  speed, 
effectiveness,  and  motivation. 

q  Medium  resolution  color  graphics  add  options  for  two 
dimensional  simulations,  generative  interactions,  and 
reformatting,  but  the  cost  is  high  (about  $3,700).  This 

CAPABILITY  MAY  BE  RESERVED  FOR  SPECIAL  APPLICATIONS  AS 
AN  ADD  ON  TO  AN  EXISTING  SYSTEM. 

9  Beyond  1985,  high  resolution  television  may  become  a  new 
standard.  This  event  would  alter  cost/benefit  results, 

AND  SHOULD  BE  FOLLOWED  CLOSELY. 

•  Still  frame  audio  on  optical  memory  storage  systems  (e.g., 

VIDEODISCS)  IS  ESSENTIAL  FOR  LOW  COST  TRANSFER  OF  TEC 
AND  ETV  MATERIALS. 

•  Many  issues  remain  about  the  player. 

These  include: 

--Cost  of  still  frame  audio 
--Photographic  and  magnetic  alternatives 
--Analog  vs.  all  digital  storage 
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o  Keypad  plus  touch  panel  is  adequate  for  input,  but  an 

INTEGRATED  HAND  HELD  CURSOR  CONTROL  WITH  KEYPAD  SHOULD 
BE  INVESTIGATED. 

O  TEC  AND  ETV  CAN  GO  DIRECTLY  TO  NTSC  VIDEO,  BUT  STILL 
FRAME  AUDIO  WILL  REQUIRE  REFORMATTING. 

o  Print  reformatting  to  NTSC  video  requires  considerable 

REFORMATTING. 

9  Authoring  systems  and  text/graphic  editors  are  one  of 
the  most  critical  factors  FOR  effective  use  of  the  new 

DELIVERY  SYSTEMS. 

o  General  issues  remaining  include; 

--A  MANAGEMENT  SYSTEM  TO  IMPLEMENT  THE  PLAN  FOR 

Continuing  Individual  Training  in  units,  for 

MANAGEMENT  OF  TEAM  TRAINING,  AND  FOR  TRAINING 
RESOURCES. 

--Training  NCO's  to  train 
--Interaction  strategies 
--Integrating  SQT's  and  SQT  practice  into  job 
training 

--Integrating  ARTEP  into  on-the-job  training 
--Integrating  job  aiding  with  training 
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CONCLUSIONS  AND  RECOMMENDATIONS 
FOR  MILITARIZED  ELECTRONIC  DELIVERY 
SYSTEMS  FOR  SPA'S 


•  Flat  panel,  monochromatic  medium  resolution  display  is 


ADEQUATE.  GRAY  SCALE  NOT  REQUIRED. 


o  Developments  in  rugged  solid  state  memories  (including 
optical  pocket-sized  cards)  should  be  tracked  closely  for 
this  system  type. 


a  Audio  output  during  maintenance  aiding  needs  to  be  invest¬ 
igated  in  the  field,  but  does  not  appear  to  be  a  require¬ 
ment  . 


•  Voice  input  for  maintenance  aiding  needs  to  be  investigated 
in  the  field.  Currently,  inexpensive  voice  input  systems 
are  inadequate.  The  adequate  systems  are  very  expensive, 

BUT  THEIR  PRICE  WILL  FALL  DRAMATICALLY  WHEN  THEY  ARE 
PLACED  ON  A  SINGLE  COMPUTER  BOARD  AND  PURCHASED  IN  LARGE 
VOLUMES. 


•  Reformatting  for  SPA's  will  be  investigated  in  the  Data 
Base  Correlation  Study. 


•  Authoring  systems  for  SPA's  are  needed. 


REMAINING  ISSUES 

FOR  HAND  HELD  RATING  AND  INVENTORY  DATA  ENTRY  SYSTEMS 

9  Design  of  the  data  display. 

o  Functions  to  be  performed  (e.g.,  scoring  for  SQT  and 
ARTEP,  inventory  management). 

o  Storage  device. 

•  Design  of  the  keypad. 

o  Protocols  for  each  function. 
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CHAPTER  1 

INTRODUCTION:  PURPOSE  AND  METHOD  OF  THIS  STUDY 


The  Purpose  of  This  Study 


The  mission  of  the  Army  Commun icat i ve  Technology  Office  (ACTO) 
is  to  reduce  the  Army's  reliance  on  the  current  paper  and  voice- 
based  delivery  systems.  To  do  tnis,  ACTO  conducts  research 
and  development  and  develops  specifications,  all  leading  to 
the  eventual  introduction  of  new  electronic  information 
delivery  systems.  In  fulfilling  this  mission,  ACTO  has 
initiated  a  series  of  research  and  development  protects  to 
analyze  the  costs,  benefits,  and  engineering  considerat ions 
related  to  electronic  and  optical  technologies  for  informa¬ 
tion  storage  and  communication.  These  studies  have  dealt 
with  such  topics  as  the  costs  of  optical  videodiscs  vs. 
conventional  print  and  audic-visual  media,  the  effectiveness 
of  videodiscs  and  microcomputers  in  training  and  in  maintenance 
aiding  problems,  procedures  for  converting  existing  print 
ar.d  audio-visual  media  to  ne-v.  delivery  system  forms,  and  types 
of  storage  media  technologies  applicable  to  new  distributed 
communi cat ive  electronic  delivery  systems.  This  is  the  final 
report  in  another  study  of  this  series.  It  deals  with  the 
presentation  features  of  electronic  delivery  systems  and  their 
use  in  a  variety  of  scenarios  in  the  Army.  In  this  chapter,  the 
purpose  and  methods  of  the  study  will  be  reviewed. 


The  Problem. 


Before  mid-century,  the  U.S.  Army  was  much  less  complicated. 
There  ware  far  fewer  weapon  systems  and  these  systems  were  of 
far  less  technological  complexity.  The  work  force  available 
to  the  Army  was  more  literate  in  the  use  of  written  and 
spoken  English,  and  was  in  some  ways  better  prepared  in  basic- 
mathematical  and  technical  subjects.  The  expense  of  conduct i nm 
operations  and  training  was  much  less.  The  equipment,  its 
operation  and  maintenance  was  less  complex  and  costly  to  deploy, 
use.  and  train.  The  mayor  driving  forces  creating  today's 
problems  in  training  and  maintaining  are  the-  following: 

(1)  Technological  changes 

(2)  Societal  cnangos 

(  3  /  E  c  on  or.  i  c  c  b  a  r.  g*  -  - 

The  technological  changes  include  more,  and  more  complex  n-.-y 
weapon  systems  than  ever  before  in  the  U.S.  Army.  While  it 
is  possible  to  use  human  engineered  approaches  and  built -in 
te-st  equipment  to  reduce  tin-  conplexi  t  y  e-f  operations  and 
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maintenance,  these  approaches  often  merely  introduce-  nc-v. 
equipment  or  software  complexity.  It  is  not  only  the-  increase 
in  complexity,  but  the  increase  in  quantity  of  technological 
61  %  systems  per  soldier  that  increases  the  training  requirements. 

There  are  more  weapon  systems  and  tools  to  operate  and  maintain, 
and  they  have  become  more  complex  and  sophisticated  in  concept 
and  operation.  The  net  effect  is  increased  requirements  for 
training  and  for  the  selection  of  more  technically  qualified 
personnel . 

To  compound  the  problem  of  increasing  demand  for  more  technical 
skills,  society  has  been  changing.  The  labor  pool  is  shrinking. 
As  the  number  of  19  year-olds  decreases,  comp-;  1 1 1 1  on  increases 
from  business,  industry,  and  the  life  of  a  welfare  recipient. 

Thus  there  are  fewer  recruits  available.  In  addition,  the 
quality  of  the  recruits  has  changed.  An  increasing  number  of 
them  have  Spanish  or  another  language  as  their  native  language. 
Many  have  not  been  successful  academically.  This  translates  into 
lack  of  success  with  written  and  spoken  English,  the  basis  for 
the  current  delivery  system. 

Economic  changes,  occasioned  both  by  the  cost  of  the  Army's 
inventory  and  personnel,  and  by  economic  inflation,  have  made  it 
more  and  more  difficult  to  provide  realistic  training. 

Ammunition  and  petroleum  are  too  costly  to  be  used  up  in 
extended  training  maneuvers.  Transportation  from,  one  place 
to  another  where  training  can  be  obtained  is  increasingly 
costly. 

The  cuirent  delivery  systems  for  recruiting,  training, 
communication? .  maintenance,  and  logistics  are  primarily 
based  on  paper  and  on  voice  communications..  This  has  resulted 
in  an  enormous  increase  in  the  volume  of  paper,  a  specific 
symptom  of  the  underlying  problems  which  prompted  the  creation 
of  ACTO  several  years  ago.  Many  publications  cite  the 
incredible  growth  in  the  number  of  pages  required  to  document 
new  weapon  systems  for  both  operations  and  maintenance. 

The  processing  of  paper  is  a  problem  in  all  areas  where  hum.au 
communication  occurs  lor  any  of  the  Army's  purposes. 

In  all  Army  activities,  the  limits  of  capability  of  the  current 
delivery  system,  arc  simply  being  exceeded.  The  paper  manage-  r.t 
problem  is  one  symptom.  The  inadequacy  of  training  resulting 
in  reduced  force  readiness  is  a  more  serious  symptom.  In  many 
cases,  today's  soldiers  are  not  able  to  operate  or  maintain  tht 
complex  system.?  in  our  Army's  inventory.  Their  non-English  ar.i. 
non-academic  background  increasingly  makes  it  difficult  for  t  lit-:, 
to  obtain  adequate  training  or  to  understand  ccmmun i cat  ion  - 
adequate! v  through  the  current  verbal  del  a  very  system. 


Th e  Opportunity 

The  opportunity  to  meet  the  Army’s  increasingly  difficult 
problems  comes  from  two  relatively  new  developments  in 
science  and  technology.  One  class  of  developments  has 
produced  new  hardware  and  communication  technologies, 
the  other  has  yielded  much  broader  and  more  complete  under¬ 
standing  of  teaching,  learning,  and  communicating. 

Hard  Technologies 


Modern  technology  has  introduced  many  of  the  problems 
through  invention  of  the  many  new  and  diverse  weapon  systems. 

It  may  also  provide  part  of  the  solution.  The  opportunity 
arises  from  three  powerful  new  technologies : 

(1)  Computer  chips  which  provide  processing  power 
for  simulations,  testing,  records,  scheduling, 
management  aids,  etc. 

(2)  Optical  memories  which  provide  storage  and  distri¬ 
bution  of  video,  audio,  and  interactive  computer 
programs,  and  not  just  text. 

(3)  Satellite  and  fiber  optics  communication  networks 
which  provide  a  new  means  for  the  distribution  of 
information  and  lor  assurance  that  information  is 
received  and  acted  on  properly. 

It  is  through  these  new  storage  and  communication  technologies 
that  ACTO  can  make  a  major  impact  on  the  current  problems. 

The  essential  contribution  of  the  computer  chips  is  to  permit 
the  low-cost  replication  of  interactions.  Such  interactions 
occur  between  skilled  teachers  and  students,  betweer  a  skilled 
coach  and  a  person  being  guided  in  maintenance,  between  someone 
ordering  and  someone  receiving  in-office  processing.  The  list 
is  endless.  The  computer  chips  enable  replication  or 
prompting  of  many  of  the  transactions  that  occur  in  interactive 
two-way  communications  between  two  or  more  people.  Rules  ar.d 
doctrines  for  office  work,  personnel  transactions,  logistics 
transactions,  training  transactions,  and  maintenance  aiding 
transactions  can  all  be  built  in  to  the  memories  and  programs- 
that  control  the  computer  processors,  on  chips  no  larger 
than  the  little  fingernail.  These  chips  can  be  distributee, 
carrying  the  intelligence  to  reproduce  or  prompt  these 
interactions  reliably  in  multiple  locations  throughout  th- 
wor 1 d . 
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The  promise  of  optical  memories  is  to  move  beyond  the  old 
delivery  systems  restricted  solely  to  print  and  voice.  Optic;:] 
memories  can  store  enormous  quantities  of  video  information, 
audio  information,  and  interactive  computer  proprams,  as  well  as 
text.  The  pictures  and  text  can  be  displayed  in  full  color  and 
with  background  audio  on  electronic  display  screens.  Text 
can  be  greatly  reduced  and  displayed  in  life-sized  chunks, 
or  can  be  associated  with  audio  for  poor  readers.  Large  quar.tit 
of  information  can  be  replicated  more  inexpensively  than  can  the 
same  quantity  of  printed  text  and  audio-visuals.  Actual  motion 
pictures  modeling  persons  performing  complex  operational  or 
maintenance  procedures  can  be  stored  in  optical  memories, 
either  as  full  motion  with  audio  or  as  a  series  of  still 
pictures  with  or  without  audio.  Where  print  i -  inaccessible 
to  semi -1 i terat e  soldiers,  pictures  and  audio  are  easily 
accessible  and  interactive  programs  provide  the  practice  and 
prompting  required  to  communicate. 

It  will  be  several  years  before  satellite  and  fiber  optics 
communication  networks  are  fully  implemented  throughout  the 
Army,  but  more  primitive  electronic  communication  network.- 
now  exist.  Also,  the  ultimate  goal  of  fully  functioning 
networks  can  now  be  readily  approximated  by  distributing 
data  bases  on  computer  chips  and  optical  memories.  That  is. 
processing  that  now  takes  place  centrally  can  be  distributed 
out  to  the  end  users  and  only  brief  data  summaries  r.eec  be 
sent  up  the  narrow-band  communication  channels  now  in 
existence.  In  the  more  distant  future,  broad-band  communica¬ 
tion  networks  can  connect  the  distributee  processes  together. 

In  either  case,  data  accumulated  in  field  operations  car.  bt 
summarized  and  commanders  can  be  assured  that  training  and 
operational  missions  are  being  carried  out  correctly  i  r. 
the  field . 


Soft  Technologies 

The  other  new  development  is  a  result  of  progress  in  soft 
technol oci es .  Whether  called  science  or  art  .  these  soft 
technologies  have  made  great  progress  in  the  last  20  year.-  . 
Many  of  the  specialists  prefer  to  call  their  specialty 
"sciences"  (Instructional  Science  .  Cognitive  Science  . 
Communi cat  ion  Science.  Computer  Science,  Economics,  etc.;. 
Others  are  more-  pragmatic  (Instructional  Systems  Develop¬ 
ment  .  Design  Engineering.  Message  Design,  Imp]  emen  t  at  i  or. 
Design.  Configuration  Management  .  Organ izat  ional  Behavior  '• 
Whatever  the  preference  for  dividing  disciplines  up  inti 
specialties  and  naming  them.,  practitioners  experienced  m 
the  field  are  coring  t  c  roi-fcn  i  and  acre-  up.  -n  a  minim..  1 
set  cif  processes  .  act  i  v:t  i  e.-  .  and  (  om;  ore  nt :  r.  the-  t  vt  a  ' 
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picture  of  introducing  new  technological  delivery  systems 
into  different  social  organ izat ions  and  assuring  their 
cont i n  u a  t ion. 

In  this  paper,  some  concepts  that  have  been  developed  by  WICA7 
Incorporated  in  a  comprehensive  model  of  teaching  and  learning 
will  be  used  to  explain  the  minimum  set  of  delivery  systems 
for  which  communicative  electronic  systems  should  be  developed. 
This  analysis  and  presentation  of  a  comprehensive  view  of  these 
different  delivery  systems  is  presented  in  chapter  2.  These  r.-v. 
conceptions  of  both  teaching  ana  teaching  support  processes , 
and  of  learning  and  learning  processes  are  a  part  of  the  new 
opportunity  that  presents  itself.  Failure  to  recognize  all  of 
the  parts  of  the  puzzle,  parts  which  can  only  be  solved  by  tie. 
soft  technologies,  is  to  fail  to  use  the  hard  technologies 
proper.- . 

As  personnel  in  the  Army  begin  to  interact  with  electronic- 
displays  instead  of  printed  pages,  the  question  of  presentation 
features  of  the  displays  and  response  devices  provided  becomes 
critical.  The  purpose  of  this  study  is  to  investigate  these 
presentation  and  response  features  and  to  propose  how  they 
will  affect  the  design  of  future  communicative  information 
delivery  systems. 

.Vet  hod  Vsed  for  This  Stud;: 

The  thrust  of  this  prefect  is  to  qualitatively  analyze  the 
cost /effectiveness  lor  electronic  delivery  systems  of  a  number 
of  presentation  features.  The  targeted  features  have  beer, 
investigat'd  in  a  number  of  studies  in  the  human  factors, 
educational  psychology,  and  cognitive  psychology  fields.  There¬ 
fore,  one  of  thf  central  elements  of  the  study  was  to  conduct  a 
literature  review,  paying  particular  attention  to  the  recent 
summarizing  statements  and  guidelines  of  a  number  of  investigators. 
These  results  are  primarily  presented  in  chapters  3  and  4,  which 
are  concerned  with  instructional  design  and  human  factors 
considerations  for  presentation  features. 

In  order  to  gather  data  from  the  actual  users,  interviews  were 
conducted  with  army  personnel  in  many  different  programs.  Visits 
were  made  to  Ft.  Sill,  Oklahoma;  Aberdeen,  Maryland;  Ft.  Bliss 
and  Ft.  Hood,  Texa.-;  Ft.  Eustis,  Virginia;  Ft.  Monroe,  Virginia; 

Ft.  Monmouth,  New  ..Ursty;  Ft.  B.-r.  tarn  in  Harrison;  and  Ft.  Gordo:., 
Ge-orgia.  In  addition,  the  Master  Automation  Plan  Office  (MAP- 
was  visited  in  V.  ash  met  •  a  . 
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Experiments  were  another  important  element  in  the  study.  Since 
the  videodisc  may  be  one  of  the  central  elements  of  an  electronic- 
delivery  system,  we  decided  to  use  several  actual  videodiscs 
for  our  studies.  In  order  to  dc>  this,  we  first  placed  a  series 
of  dials  and  gauges  taken  at  calibrated  distances  on  the  back 
of  a  videodisc  made  for  the  Defense  Advanced  Research  Projects 
Agency  (DARPA).  These  graduated  and  calibrated  images  permitted 
us  to  estimate  the  resolution  of  a  standard  NTSC  videodisc  and 
monitor.  This  information  was  also  helpful  in  determining  the 
extent  to  which  reformatting  may  be  required  for  existing  primed 
materials  in  order  to  place  them  onto  a  low  to  medium  resolution 
videodisc  system.  The  results  are  reported  in  Experiment  3 
(Appendix  B.. 

We  were  also  fortunate  in  that  we  had  just  prepared  a  videodisc 
for  the  Army  Research  Institute  (AP.1>  which  included  training 
and  simulation  for  a  relatively  complex  artillery  procedure. 

We  were  able  to  reprogram  this  procedure  for  the  Presentation 
Features  project  in  order  to  evaluate  the  effectiveness  and 
preference  by  students  for  a  number  of  different  input  devices. 

The  results  are  presented  in  Experiment  5  (Appendix  D). 

As  part  of  this  study  we  had  determined  that  the  existing  research 
showing  no  difference  between  line  drawings  and  full  color 
pictures  had  for  the  most  part  been  conducted  using  only  paper 
and  pencil  performance  measures.  We  therefore  decided  to 
determine  whether  these  results  hold  up  where  performance  is 
measured  by  a  hands-on  task.  A  special  disc  was  designed  for 
this  purpose.  The  disc  included  instruction  and  job  aids  which 
varied  type  of  graphic  (photograph  versus  line  drawing),  audio 
versus  no  audio,  and  lengthy  description  versus  very  brief  actior.- 
oriented  statements. 

SONY  agreed  to  master  this  disc  without  cr.arge.  Unfortunately, 
the  mastering  was  greatly  delayed  and  the  dis>.  that  was  returned 
to  us  had  been  truncated  part  way  through  the  presentation 
of  the  materials.  Therefore,  Experiments  1  and  2  which  required 
this  disc  were  both  delayed  and  changed  in  scope.  The  results  arc 
presented  in  Appendix  A.  In  brief,  we  found  no  advantage  for  color 
photographs  over  line  drawings  for  a  hands-on  test.  We  also  found 
that  accuracy  using  job  aids  was  as  good  as  with  instruction,  and 
that  job  aids  saved  time  when  both  training  and  job  performance 
tim.es  were  considered.  In  all,  we  feel  that  some  valuable  data 
has  been  obtained  from.  Experiments  1  and  2  and,  indeed,  frer. 
the  combined  experience  with  the  three  videodiscs. 

Other  experiments  investigated  transfer  of  print  materials  to  an 
electronic  delivery  system. 

One  of  the  central  questions  which  must  be  addressed  when 
considering  use  of  ar.  electronic  system  is  the  extent  to  whicr. 
present  text  materials  must  be  reformatted  in  order  to  be  easily 
legible  on  the  monitor.  It  is  also  an  issue  as  to  the  resoiutier. 
required  in  order  to  place  text  pages  onto  a  video  monitor  wit.nr.ut 
reformatting .  At  some  level  of  resolution,  a  page  car.  be  simply 
photographed  using  a  camera  and  reproduced  electronical ly . 
Experiment  4  was  desianed  to  find  that  resolution.  The  results 
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Another  issue  of  importance  is  the  expense  to  be  anticipated 
when  converting  existing  Training  Extension  Course  (TEC)  lessons 
from  the  current  Beseler  Cue/See  format  to  video  format.  In 
order  to  gain  this  information,  we  actually  transferred  a  TEC 
lesson  and  then  reformatted  other  material  in  order  to  determine 
time  and  costs.  The  results  of  these  investigations  are  reported 
in  chapter  5. 

Presentation  Features  Criteria 


Candidate  presentation  features  considered  in  this  project  we  re¬ 
evaluated  against  three  major  criteria:  effectiveness,  cost,  ar.d 
other  benefits. 

The  effectiveness  criteria  are  based  on  user  comprehension  of 
presented  information,  the  rate  of  comprehension,  the  amount  of 
retention,  and  user  acceptance  and  motivation.  In  most  cases  it 
was  not  possible  to  quantify  the  degree  to  which  a  delivery  system 
produced  changes  in  these  areas.  Nevertheless,  it  was  often 
possible  to  compare  alternate  systems  on  these  criteria  for  a 
given  content  matter  and  group  of  subjects. 

The  cost  of  a  feature  can  be  measured  in  many  ways.  Perhaps  the 
most  obvious  is  the  hardware  acquisition  cost .  However,  this  is 
usually  outweighed  by  costs  of  hardware  ownership,  which  are 
dramatically  affected  by  the  reliability,  availability,  and 
maintainability  of  the  system,.  While  these  must  be  designed  into 
the  actual  hardware  and  thus  are  not  the  province  of  this  study, 
they  are  critical  to  system  acceptance.  Another  major  factor 
in  the  cost  of  each  feature  is  the  software  and  courseware 
development  required.  While  there  is  no  simple  means  of  describing 
the  relationship  between  a  feature  and  the  difficulty  of 
developing  materials  for  it,  it  i_s  clear  that  different  kinds 
of  costs  are  involved.  For  example,  preparing  a  computer-assi sted 
instruction  lesson  using  a  standard  monochrome  CRT  with  no  graphics 
capability  can  be  quite  simple  since  the  capabilities  of  the 
delivery  system  are  quite  limited.  On  the  other  hand,  preparing 
an  interactive  video  sequence  for  a  videodisc  can  be  extra¬ 
ordinarily  complex.  It  must  be  recognized  that  more  capabilities 
may  also  mean  more  difficulties  and  expense  in  preparing 
materials.  For  example,  should  still  frame  audio  ever  become 
available  on  a  videodisc,  we  would  not  be  surprised  to  see 
someone  try  to  utilize  a  1  I  of  the  hundreds  of  hours  of  audit 
time  available.  There  is  a  kind  of  tyranny  in  great  possibilities. 

Another  major  cost  is  software  update  and  revision.  An  optical 
videodisc  of  the  type  currently  in  use-  cannot  be  revised.  This 
is  a  serious  handicap  for  small  volume-  programs  which  cannot 
afford  to  re-vis*-  the  disc  to  meet  changing  doctrines,  hardwurt  , 
and  the  like.  Or.  the  other  hand,  the  computer  permits  ver. 
rapid  updates  of  information  stored  in  its  magnetic  memor;.  .  B\ 
marrying  the  audio  visual  capabilities  of  the-  videodisc  with 


the  rapid  update  capabilities  of  the-  microcomput er  system,  it 
may  be  possible  to  make  less  expensive  updates  and  revisions 
to  electronic  delivery  system  programs. 

The  third  major  criterion  is  the  type  of  benefits  provided. 

One  type  of  benefit  is  simplicity  of  use.  Another  is  compatibility 
with  existing  delivery  systems  like  print  and  Cue/See.  Others  are 
compatible  components,  and  rapidly  expandible,  easily  replicated 
systems  which  are  available  for  fast  response  in  case  of 
mobi 1 izat ion . 

Organ i 2 a t ion  of  the  Chapters 

The  work  in  this  project  consisted  of  three  major  components. 

The  first  was  tc>  define  how  the  systems  will  be  used.  Charter  b 
presents  this  information.  The  second  component  was  to  uss 
the  existing  research  and  new  experiments  to  determine  the 
effectiveness  and  other  benefits  of  candidate  features.  The 
results  of  this  work  are  reported  in  chapters  3  through  7.  The 
last  component  was  to  estimate  costs  for  quantity  purchases  in 
19S5  to  obtain  the  different  features.  A  cost  benefit  tradeoff 
was  used  to  recommend  a  set  of  preferred  features  and  a  set  of 
lowest  feasible  cost  features  for  each  type  of  system.  This 
analysis  is  presented  in  chapter  8.  Chapter  9,  "Looking  Ahead," 
presents  the  most  important  points  from  all  three  components. 
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CHAPTER  2 

SCENARIOS:  REQUIREMENTS  FOR  ELECTRONIC  DELIVERY  SYSTEMS 
TO  IMPROVE  COMMUNICATIONS,  TRAINING  AND  MAINTAINING 

PRESENTATION  FEATURES 

In  a  previous  report  in  this  ACTO  series*,  six  scenarios, 
each  with  several  sub-scenarios,  were  defined.  A  scenario 
describes  new  but  realistic  ways  that  electronic  delivery 
systems  may  be  used  by  Army  organizations.  As  scenarios  are 
made  more  and  more  specific  they  lead  to  development  plans.  These 
influence  several  key  activities:  the  design  of  the  new  elec-troni 
delivery  systems,  the  reorganization  of  the  work  now  being 
performed  by  each  Army  work  group  considered,  and  a  strategy 
for  moving  from  the  current  to  the  future  scenario.  This 
chapter  will  not  repeat  the  description  of  the  six  scenarios 
given  in  the  previous  report.  However  it  will  attempt  to  make 
these  scenarios  more  understandable  in  relat ionship  to  ACTO's 
mission.  This  chapter  will,  in  addition,  describe  a  few 
additions  to  scenarios  from  the  previous  report .  Finally,  this 
chapter  will  take  a  first  cut  at  defining  that  minimal  set  of 
hardware  components  that  can  be  used  interchangeably  across  the 
various  scenarios. 

The  discussion  in  this  chapter  flows  from  the  general  to  the 
specific.  First  ACTO's  mission  is  defined  and  the  kinds  of 
organizations  are  identified  whose  work  could  be  improved  by 
the  use  of  electronic  technology.  Live  different  kinds  of 
teaching  systems  are  identified.  The  various  sub-scenarios 
described  in  the  previous  report  are  related  to  these  five 
kinds  of  systems.  The  scenarios  describe  how  electronic 
technology  can  improve  the  productivity  of  the  work  performed 
by  each  kind  of  organization. 

The  chapter  concludes  by  identifying  a  set  of  five  different 
delivery  systems  that  can  be  used  across  the  scenarios. 

It  is  important  to  narrow  the  requirements  for  electronic 
delivery  systems  in  this  way  and  find  a  minimal  set  that  can  be 
used  interchangeably  across  scenarios.  The  problem  is  that  as 
the  electronics  industry  continues  its  enormous  growth  worldwide, 
a  seemingly  endless  stream  of  new  applications  and  products 
flows  forth  from  this  industry.  These  products,  unfortunately, 
may  be  poorly  matched  to  the  Army’s  requirements.  What  is  the 
minimum  family  of  electronic  delivery  systems,  some  lor  training, 
some  for  maintenance,  some  for  management,  some  for  office  work? 

A  minimum  but  inclusive  set  of  modular  hardware  and  software- 
components  will  pi vt  the  Army  (and  perhaps  other  agencies  o:  th- 
Department  of  Defense)  sveral  auvantages.  One  advantage  is  tn- 
economies  of  scale.  Other  advantages  are  simpler  naintair.abi  1  ity , 

*  Bunderson ,  Pett  and  Bearnsor. ,  Storage  Media  for  Electronic 
Delivery  Systems,  ACTO  Technical  Report  ,  Feb.  1  bt-  . 
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simpler  training  and  education  of  Army  personnel  in  the  use 
of  the  new  delivery  systems,  and  other  advantages.  By  contra 
a  piecemeal  approach  to  this  problem  will  saddle  the  Army  wit 
a  variety  of  incompatible  and  expensive  electronic  systems, 
many  of  them  adapted  wholesale  from  the  consumer  market  and 
utilized  in  Army  situations  where  they  do  not  fully  meet  the 
requirements.  In  order  to  define  a  minimal  set  of  scenarios 
some  logical  analysis  of  ACTO ' s  mission  is  required. 

ACTO's  Mission  and  the  Organizations  it  Serves 

The  mission  of  the  Army  Communicative  Technology  Office 
includes  the  following  major  responsibilities: 

(1)  Life  cycle  development  and  management  of  military  systems 
for  production,  distribution,  and  delivery  of  doctrinal, 
instructional,  and  technical  materials. 

(2)  Exploration  of  military  applications  of  electronics 
technology  for  conveying  information  in  communicative 
systems . 

(3)  ACTO  is  to  serve  as  the  principal  focal  point  below 
headquarters,  the  Department  of  Army  for  organization 
and  support  for  these  activities. 

In  short,  ACTO  is  to  help  the  Army  choose  from  communication 
of  information  by  paper,  which  is  producing  so  much  paper  the 
Army  is  in  danger  of  "drowning  in  it,"  to  electronic  communication. 


The  Simplest  Case  Description  of  the  Communication  Process 


As  defined  in  earlier  ACTO  publications,  the  communicat ive 
process  is: 


"a  method  of  transferring  ideas  that  insures  understanding 
of  meaning  and  intent." 


Generally,  the  communication  process  has  been  conceptualized 
as  occurring  between  a  sender  and  a  receiver.  This  makes 
communication  a  two-person  problem.  That  is,  by  identifying 
all  variables  and  activities  that  take  place  in  2-person 
communication  we  have  solved  the  problem  for  any  number  of 
people.  However,  even  early  writers  in  the  theory  of  communi¬ 
cation  (Cherry,  1966)  have  discussed  communicat ion  as  occurring 
in  networks  of  more  than  two  people.  What  is  the  simplest  cast 
problem  for  analyzing  communication?  When  a  physical  scier.tis* 
approaches  a  difficult  new  area,  he  tries  to  define  the  sim¬ 
plest  case  problem.  That  is,  a  problem  that  has  inherent  in 
it  all  of  the  properties  of  the  general  case.  Then  the  solution 
to  that  simplest  case  problem  is  general.  It  may  be  less  us-:  - 
ful  to  construe  communication  logically  as  a  two-person  or 
two-element  problem,  (sender  and  receiver).  It  may  be  more  use¬ 
ful  to  construe  it  as  a  three-person  problem.  This  concept  is 


rr  in 
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depicted  in  Figure  2-1.  The  objective  is  now  for  the  sender 
to  send  the  message  to  the  first  receiver  and  for  the  receiver 
to  capture  it  fully,  sufficient  to  convey  it  on  to  a  third 
person.  This  is  generally  the  situation  in  any  real  communi¬ 
cation.  There  may  be  times  when  a  sender  needs  to  communicate 
a  message  only  to  one  party,  but  most  often,  especially  in 
a  military  chain  of  command,  the  sender  desires  something 
to  happen  as  a  result  of  the  message.  This  most  often  involves 
a  third  person  or  several  third  persons.  Thus,  in  Figure  2-1 
we  have  depicted  the  simplest  communication  processes  occurring 
between  a  sender,  a  receiver,  and  a  second  receiver  communi¬ 
cating  with  the  first  receiver.  The  dotted  arrow  going  back 
from  receiver  to  sender  indicates  a  chance  to  query,  to  "ensure 
understanding  of  meaning  and  intent"  (ACTO  definition).  However, 
the  real  t est  of  whether  "understanding  of  meaning  and  intent" 
was  achieved  is  through  testing  the  message  received  by  the 
third  person .  If  this  message  has  been  received  properly, 
then  we  know  we  have  solved  our  communication  problem,  because 
the  same  processes  can  occur  from  a  second  person  through  the 
third  person  to  a  fourth  person  and  so  on.  Thus,  the  three 
person  communication  problem  represents  the  simplest  case  that 
is  complete.  Thus,  in  a  command  communication,  it  is  essential 
that  the  message  of  a  commander  go  through  one  or  more  inter¬ 
mediaries  and  be  received  properly  by  those  at  the  line  level 
responsible  for  carrying  it  out. 

Training  is  a  special  case  of  communication.  In  teaching  and 
learning,  the  communication  problem  becomes  a  three  person 
teaching/learning  problem.  For  example,  in  a  TRADOC  school, 
the  learner  receiving  the  message  must  do  so  thoroughly,  and 
must  continue  to  work  to  perfect  his  mastery  of  the  job  taught 
so  as  ultimately  to  be  able  to  communicate  to  co-workers  (third 
persons)  about  it,  use  the  skill  in  actual  performances,  and  in 
some  cases  even  teach  it  to  someone  else.  In  the  case  of 
training,  the  idea  of  a  third  person  is  a  way  of  assuring  that 
what  is  commun icated  in  training  situations  is  fully  mastered 
and  used  correctly  on-the-job,  perhaps  long  after  the  initial 
training.  This  means  that  the  learner  is  progressing  up  an 
Army  career  path,  becoming  an  NCO  or  perhaps  an  officer  who 
must  teach  others. 


Figure  2-2  is  another  way  to  show  the  importance  of  what  happens 
after  the  second  person  receives  the  message  in  an  AIT  school. 
Tne  ordinate  of  Figure  2-2  indicates  the  percent  of  mastery 
in  a  military  career  (from  0  to  100).).  The  base-line  indicates 
time--the  soldier's  life  and  career.  Three  time  phases  are 
indicated.  The  readiness  phase  involves  the  soldier's  horn- 
and  school  experiences  prior  to  joining  the  Army.  Phase  II  in¬ 
volves  face  to  fact-  learning  that  occurs  in  a  TRADOC  school. 
Phase  III  is  a  much  longer  mastery  of  his  military  occupation. 
Figure  2-2  makes  several  points  clear: 

(1  )  The  readiness  of  the-  soldier  has  a  great  impact  or.  what 
can  be  accomplished  during  the  schooling  phase  i  r.  t  h*. 
modern  Army.  The  soldier's  grasp  of  written  and  sr  ■••k*. 
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Communication  or  training  is  a 
Three-Person  Problem 


Recruiting  Army  School  On-the-job 


iqnti'  ?  7  Throf?  ,>har.o  in  achieving  mastery  in  a  military  earner. 
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English  and  of  technical  and  scientific  concepts  is 
most  significant  in  determining  how  well  and  how  fast 
training  information  will  be  grasped.  In  addition, 
the  soldier's  personal  habits,  study  habits, 
aspirations,  and  self  concept  are  or  great  importance 
in  learning  initially  and  in  continuing  to  grow. 

(2)  The  impact  of  the  TRADOC  school  is  small  in  the 
total  time  picture,  but  could  be  quite  large  in 
its  effect.  The  experience  in  the  TRADOC  school 
affects  the  slope  of  the  line  during  the  on-the-job 
phase.  This  line  could  progress  upward  toward 
mastery,  or  could  lead  to  so  little  on-the-job 
accomplishment  as  to  contribute  to  an  early  exit 
from  the  service. 

(3)  By  far  the  most  significant  phase  is  the  on-the-job 
learning  phase.  This  is  significant  both  on  the 
basis  of  common  sense  and  on  the  basis  of  necessity. 

Our  common  experience  assures  us  that  great  learning 
occurs  when  we  actually  do  the  jobs  that  are  mostly 
talked  about  during  formal  face  to  face  schooling. 
Necessity  has  lead  TRADOC  to  the  doctrine  that  most 
training  responsibilities  must  be  exported  to  the 
units  and  must  occur  on  the  job. 

Figure  2-2  maki-s  the  noi  r.r  that  common i cat  ing  mastery  in  a 
military  career  from  a  series  of  teachers  to  a  1  earner  is  a 
long-term  process  and  that  ACTO ' s  mission  to  "transfer  ideas 
in  a  way  that  ensures  meaning  and  intent"  is  something  that 
must  focus  on  the  total  career  man  a  cement  of  the  soldier. 

This  involves  recruiting  soldiers  with  a  maximum  degree  of 
readiness,  teaching  during  the  formal  schooling  phase,  and 
(most  importantly)  the  teaching  and  growth  that  occurs  on  the  job. 

Looking  at  communication  and  training  as  a  3-person  problem, 
rather  than  as  a  2-person  problem  is  more  consistent  with 
the  realities  depicted  in  Figure  2-2.  If.  for  example,  we 
look  at  training  and  training  support  as  occurring  only  bt-  *  w  •_ 
the  school  instructor  and  the  soldier,  we  do  not  adares.-  th\ 
problem  of  carrying  the  training  information  and  skills  or.  to 
the-  persons  at  the  soldier’s  later  duty  assignment  ■■■  .  What 
will  help  the  soldier  realize  that  this  is  part  of  his  dvr.'.' 

He-  may  be  called  upon  later  to  explain,  to  demonstrate,  or 
if  promoted,  to  teach  others  what  he  is  learning.  What  mater:..!  - 
and  aids  can  be  provided  to  help  the  soldier  do  these  things 
later  on  the  job?  How  can  career  cour.selina  ana  assignments 
take  place  to  keep  the  second  and  third  persons  at  it  long  enough 
to  achieve  rr.astery--vhich  will  not  have  been  attained  during  the 
TRADOC  school  phase? 
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Military  Organ Iza  t_i  or.s  and  Thc-i  r  Del  i  vt  ry _ Sy  s_t  <.  r.s 

ACTO ' s  mission  is  to  help  military  organizations  communicate 
-  -  and  process  information  electronically  instead  of  by  means  of 

«•  current  paper-based  delivery  systems.  The  goal  of  all  of  this 

is  improved  force  readiness.  A  military  organization  is  a 
group  of  people  in  defined  roles  who  have  a  particular  mission. 
Any  organization  has  a  set  of  regulations  and  unwritten 
traditions  and  uses  a  delivery  system  (set  of  technological 
tools)  to  accomplish  its  mission. 

A  delivery  system  may  be  defined  as  follows: 

A  delivery  system  is  the  technological  component  of  ar. 
organization,  used  by  tne  organization  to  aid  in  the 
accomplishment  of  its  work. 

This  definition  is  much  broader  than  the  usual  definition  of 
a  delivery  system. 

Current  View  of  Delivery  Systems.  The  current  view  of  delivery 
systems  is  quite  limited.  Print  and  voice  communicat  ions  domir.a 
and  constrain  our  ability  to  imagine  new  ways  of  accomplishing 
the  same  work.  In  education  and  training,  delivery  systems  are 
seen  primarily  as  printed  or  audio-visual  presentation  devices 
which  may  or  may  not  accept  student  responses.  These  devices 
are  mostly  passive,  linear,  and  noninteractive  and  do  not  exploi 
the  three  powerful  technologies  discussed  as  opportunities  in 

_  the  last  chapter.  Thus,  an  expanded  view  of  delivery  systems 

is  necessary. 


Delivery  Systems  are  More  than  Audio-Visual  Presentation 
Devices .  Delivery  systems  for  communication  or  training  need 
not  be  limited  to  presenting  displays  and  accepting  responses: 
delivery  systems  can  effectively  deal  with  all  of  the  work 
involved  in  the  various  transactions  that  occur  between  three 
people  in  organizations-  the  three-person  communication  or  train 
ing  problem.  These  transactions  can  occur  either  face  to  face 
or  in  distributed  remote  configurations.  The  question  then 
becomes,  "How  can  the  new  technologies  leverage  all  of  the 
informative  work  in  organizations’1" 

Successful  Information  Deliverv  Involves  More  Than  Hardware. 


In  the  first  chapter  the  opportunity  for  the  Army  was  seer,  as 
coming  from:  both  hard  science  and  technolog\  and  soft  scit-:..-. 
and  technology .  The  soft  science-  is  clearly  needed  tu-caus- 
delivery  system,  hardware  is  not  enough .  Tie  go  a  1  is  n  it...  : 
the  productivity  of  the  organ izat  ion.-  as  now  const  itutt-ti  i 
their  performance  of  the  Army's  missions.  but  as  mentioned 
earlier,  these  organizations  involve  three  components: 


People  in  defined  roles 
Writte-n  and  ur.v.ritte:  r 
The  t echnol or i ea :  tools 


d>  1  i  v 
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A CTO  can  help  Army  organizations  periorm  their  work  mere 
productively  through  new  technological  tools  — "hard  technologies 
The  people  and  their  traditions  must  be  considered  or  the  uv. 
tools  will  not  be  accepted  or  used  properly.  The  three -fold 

|  •  definition  of  an  organization  is  illustrated  in  Figure  2-3. 

The  symbol  for  an  organization  using  a  delivery  system  used 
in  the  figures  in  this  chapter  is  a  large  arrow  emerging  from, 
a  large  bracket.  Inside  the  bracket  can  be  listed  both  the 
processes  used  in  the  communication,  and  the  content  to  be 
communicated  or  delivered.  The  processes  and  content  may  be  con 
by  some  technological  aids,  or  by  the  people  ir.  the  situat  ion . 
All  of  them  operate  according  to  a  certain  set  of  rules  laid 
down  by  tnc-  governing  body  that  establishes  the  right  of  the 
group  to  deliver  its  products  or  services.  These  rules  are  par: 
of  the  traditions.  A  work  climate,  usually  unwritten,  is  also 
a  part  of  the  traditions.  The  productivity  of  the  organization 
can  be  improved  by  improving  the  abilities  and  skills  of  the 
people,  by  removing  traditions  that  are  counterproductive, 
or  by  improving  the  work  climate.  Mainly,  the  productivity  can 
be  increased  by  changing  the  technological  tools.  This,  is" 
the  area  where  ACTO  is  most  closely  identified.  However, 

ACTO’s  mission  to  improve  communication  in  order  to  'ensure 
tinders:  anding  of  meaning  and  intent"  involves  a  full  consiov  r..t  : 
of  the  persons  and  traditions  which  so  heavily  influence  com¬ 
munication,  teaching,  and  learning.  Ensuring  understanding 
involves  soft  sciences  and  technologies  as  well  as  the  design 
of  delivery  systems. 

-  In  the  lower  half  of  Figure  2-3  is  indicated  an  example  of  an 

organization  that  could  use  a  new  delivery  system--: ace  to  face 
training  in  a  TRADOC  school.  The  people  in  this  organization 
are  the  teachers  and  students.  The  technologies  of  the  con¬ 
ventional  delivery  system  are  hard  copy  (books  and  fixed  media,. 

The  traditions  include  TRADOC  training  doctrine  and  the  climate 
and  morale  at  the  school.  Tne  processes  of  work  the  instructor 
must  perform  include  giving  presentations,  providing  practice 
in  work  models  (a  model,  simulation,  or  approximation  to  the 
work  the  soldier  will  later  do  on  the  job),  providing  mot  i  vat  i  on.; 
activities  to  assure  that  the  soldier  will  remember  what  is 
learned  and  will  continue  to  learn  and  improve  after  this  dav '  s 
lesson,  and  conducting  management  activities  which  ensure  th«. 
good  use  of  time  and  resources.  The  content  of  instruction 
which  the  soldier  learns  includes  combat  techniques  and  proca 
ures  (e.g.  how  to  operate  various  pieces  of  equiti.v.ent  >.  Or  it 
may  be  a  support  MOS  in  which  the  soldier  learns  to  maintain 
equipment,  surply  material,  or  conduct  admin i st rat i ve  activities. 

Orpa  nizat  i  o  ns  for  wh  id. s  cenarios  ai  -  *  n  oe_c  K  c 

Careful  consideration  of  the  thr ee-pe-rsor.  problem,  led  to  t  h- 
definition  of  five  classes  of  organ i zat ions  <  or  organized 
functions  >  needed  to  support  both  Phase  1  and  Ti.as-  13  tmn.no  . 
Similar-  kind.-  of  organ  i  z.«  t  ions  an-,  needed  :c  su.  .  r:  ■-  ■  mr.-..:.  : 
through  the  entire  t  h  r-.-e-per.--on  proves.-  . 


1 .  People 


2.  Technological  Tools 


3.  Traditions 


Figwe  2- 3a  Components  of  a"  De:  .  c-ry  Systems 


2.  Hard  Copy  and  Audio  Visuals 
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The-  reason  for  considering  these  organizations  in  this  detail 
is  that  organizations  reflect  the  delivery  systems  t  hey  us;  . 

The  old  delivery  system,  consisting  of  print  and  oral  communi- 
cation  primarily,  supports  certain  kinds  of  activities  while- 
other  kinds  of  activities  cannot  be  done  conveniently  or  cost 
effectively  at  all.  If  these  organ iza t ions  do  not  carry  out 
vital  activities  in  a  complete  or  satisfactory  way,  something 
new  is  needed.  The  three-person  problem  gives  us  a  way  of 
examining  what  would  be  required  to  solve  these  deficiencies 
of  communicating  or  teaching  all  the  way  to  the  third  person. 

It  thus  helps  us  to  understand  what  new  scenarios  are  needed. 

This  in  turn  leads  to  new  requirements  for  the  family  of 
delivery  systems  ACTO  must  design. 

The  five  types  of  support  systems  needed  to  support  all  training 
activities  necessary  in  the  three-person  problem,  are  the 
following : 

1.  Phase  I  formal  teaching  delivery 

2.  Learner  quality  assurance 

3.  Teacher  quality  assurance 

4.  Materials  development  and  improvement  < 1 SD 

5.  Phase  II  training  or  Future  Assurance 

These  will  each  be  discussed  in  turn. 

1.  Phase  I  Training  at  the  TRADOC  School.  This  type  of  teaching 
support  system  was  introduced  in  Figure  2-3.  The  terminology 
Phase  I  and  Phase  II  refers  back  to  Figure  2-2  where  Phase  6 
(soldier's  home  and  school  experience),  Phase  I  (the  TRAPOC 
schools) ,  and  Phase  II  (the  on-the-job  phase  of  learning)  were 
compared  and  contrasted. 

In  addition  to  the  TRAPOC  School,  three  other  kinds  of  suotort 
systems,  each  with  their  own  delivery  systems,  are  needed*  *ius: 
to  support  the  school  organization.  These  are  presented  in 
Figure  2-4.  The  standard  symbol  for  a  system  with  a  mission  is 
used  for  each  of  these  three  new  organizations ; that  is,  a 
bracket  terminating  in  an  arrow  pointing  in  the  direction 
in  which  the  goods  or  services  are  being  rendered.  These 
three  new  support  systems  are  numbered  2,  3,  and  4.  The 
diapram  is  Designed  to  be  self-explanatory. 

2.  Organizations  That  Peal  with  Learner  Quality  Assurance .  T  h 
U .  S .  Army  Recruiting  and  Enlistment  Command  ( I'SAREC  )  and  th>. 
Military  Enlistment  Processing  Command  (MEPCOV )  have  ma.ior 
responsibilities  in  the-  learner  quality  assurance  process,  or.* 

of  the  support  systems  logically  required  by  this  analysis. 

These  commands  are  concerned  both  with,  "learner  quality"  <ph\ 
and  mental  fitness),  and  also  quantity.  Readiness  requires  th. 
units  be  fully  staffed.  Learner  quality  assurance  deals  wits 
Phase  0  in  the  diagram  in  Ficurt  2-2.  That  is,  selecting  irm 
t  he  population  those  recruits  who  can  be-  attracted  awa\  from  otn- 
ooport  uniti  es  they  might  have,  ar.d  who  score  as  high  as  pos.-:: 
on  ph-.-ical,  language  ,  ar.d  t  <.  c  h  *  leal  sr;  ills  r<  lot  *  o  *.  «  t  n*  i  * 


Teaching  Support  System 


2.  Learner  Quality 
Assurance 


3.  Teacher  Quality 
Assurance 


4.  Materials  Ps . el 
and  Improveme 


USAREC 


MEPLOM  NCO  ?  TRADOC 


Learner  /Vg 


Traner 

— 

'  1 

i!  i 


d.  :  i«c:-art  5 vs 


1.  Teaching 
Deli  vervy 


Presentations 
Work  M odc- 
Guides 


I  j  Other  learner  or  colieaoje  cn-the-jcm 


Figure  2-4  Four  main  delivery  systems  lor  solving  the 

Three-person  teaching  problem  (Phase  I,  TRADOC 
Schools).  A  filth  system  is  needed  lor  reaching 
the  third  person(s)  on  the  job. 
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The  .ilssion  of  assuring  learner  quality  is  broader  than  US  A  EEC' 
and  MEPCOM  now  conceive  their  role.  Learner  quality  assurance 
can  also  involve  improving  the  learning  skills  and  strategies 
and  the  basic  skills  (language  and  general  technical  knowledge 
and  skills)  of  the  soldiers.  The  BSEP  program  (Basic  Skills 
Education  Program)  is  one  program  which  deals  with  this  other 
aspect  of  learner  quality  assurance. 

3.  Teaching  Quality  Assurance.  There  are  two  kinds  of  mastery 
that  must  be  attained  by  NCG's  and  officers  in  the  Army.  One 
kind  of  mastery  deals  with  their  military  occupation  specialties; 
and,  as  they  advance,  with  broader  issues  of  leadership  and 
command.  The  second  kind  of  mastery  deals  with  teaching  mastery. 
This  has  many  components,  but  includes  the  understanding  of 
Army  training  doctrine,  the  ability  to  administer  presentations 
and  work  models  (practice  situations  that  model  as  closely  as 
possible  the  soldier's  ultimate  work),  the  ability  to  motivate 
soldiers  to  learn  during  the  course  itself  and  afterwards,  and 
the  ability  to  manage  skillfully  time  and  resources  associated 
with  teaching  activities.  TRADOC  has  many  programs  to  assure 
quality  of  instructors  at  the  schools.  Questions  arise, 
however,  ir.  considering  the  three  person  problem  when  the 
trainer  is  an  NCO  out  on  the  jot  instead  oi  an  instructor  at 
a  school.  In  addition  to  teacher  quality  assurance  for  the 
NCO,  the  three  person  perspective  reminds  us  to  consider  the 
sharing  of  information  from  one  soldier  to  another  on  the  job. 

The  lack  of  good  teacher  quality  assurance  for  the  second  person 
(NCO)  and  third  person  (soldier  who  must  communicate  with 
others)  is  a  serious  deficiency  in  the  system.  These  deficiencie 
are  indicated  by  the  question  marks  in  Figure  2-4.  The  number 
"5"  by  the  small  delivery  system  symbol  going  from  the  learner 
to  other  learners  on  the  job  suggests  the  need  for  another 
delivery  system  not  indicated  in  Figure  2-4.  This  issue  will  be 
dealt  with  later. 


4.  Materials  Development  and  Improvement  (or  ISP).  This 
system  is  implemented  at  several  sites.  The  TRADOC  schools  hav 
the  primary  responsibility  for  developing  job  training  material 
in  the  areas  of  their  proponency.  The  U.S.  Army  Training  Suppo 
Center  (ATSC)  at  Ft.  Eustis  has  the  responsibility  for  managing 
the  various  exported  training  programs  such  as  the  TEC  program, 
the  SQ~  program,  the  job  training  program,  the  Army  correspon¬ 
dence  course  program,  the  Army  training  literature  program  and 
others.  The  Tobyhanna  Army  Depot  is  responsible  for  duplicatm 
and  distributing  the  exported  training  materials  to  the  field  a: 
a  variety  of  materials  to  the  schools.  As  the  symbol  pome  fro: 
materials  development  to  delivery  system  =1  shows,  these  mater; . 
must  in  cl  ud'  presentations  which  can  be  utilised  by  the  train-  r 
wore,  mod  Ms  to  provide  practice,  guides  tc  prcm.pt  motivational 
activities,  and  administrative  aids.  These  four  items  listiu  :: 
system  *1  are  shown  as  being  provided,  at  least  in  part, 
by  system.  =4.  These  four  items  help  clarify  why  distribute  d 
training  is  so  hard  in  execution.  When  the  soldiers  an  out  or 
the  in*.  ,  th*  ir  instructor  is  ar.  NCO  or  tr.iir.iru  oi  :  n  •  r.  K- 
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r  a  1  had  i  r.  s  t  r  a 


c  t .  >  r  t  r  a  :  r. : : 
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instructors  at  the  TRADOC  schools,  and  he  does  not  have  the 
facilities.  He  does  not  have  the  extensive  TASO  support  for 
audio-visual  materials.  He  may  not  have  conveniently  located 
learning  centers  or  audio-visual  devices  or  libraries  of  printed 
and  audio-visual  materials  readily  available  to  him  and  the 
soldiers  in  his  command.  The  point  here  is  that  training  and 
training  support  are  well  developed  and  implemented  at  TRADOC 
schools,  but  that  the  TRADOC  philosophy  of  exporting  the  majority 
of  training  to  the  field  must  recognize  the  need  to  provide 
the  same  kinds  of  support  in  distributed  training.  That  is, 
all  of  those  variables  and  activities- -all  the  work  needed 
to  make  training  effective  in  a  school  environment  must  be 
transformed  and  exported,  along  with  presentations,  in  order 
to  make  training  effective  in  the  on-the-job  environment.  This 
has  not  fully  been  possible  because  of  the  limits  of  the  old 
delivery  system.  The  old  delivery  system  cannot  replicate 
interactions ,  nor  much  video  and  audio  to  make  instruction 
motivating  and  powerful.  However,  the  opportunity  now  exists 
to  implement  a  delivery  system  with  new  technological  tools 
fully  capable  of  supporting  training  on  the  job.  This  is 
discussed  in  the  next  section. 


5.  Phase  II  Training  or  Future  Assurance.  Figure  2-5 
illustrates  the  needed  fifth  system  for  supporting  the  all- 
important  on-the-job  training  processes.  The  dotted  lines  in 
the  figure  shows  how  the  TRADOC  school  phase  (Phase  I)  is  now 
a  thing  of  the  past  for  the  soldiers  and  NCO's  involved.  The 
soldier  has  left  the  school  and  is  now  in  a  unit.  After  a 
time,  some  of  them  have  been  promoted  to  be  NCO's  or  training 
officers  themselves  and  are  now  required  to  teach  the  "third 
person."  Those  who  are  not  formally  responsible  for  training 
still  need  to  teach  or  communicate  (or  at  least  to  demonstrate) 
what  they  have  learned  to  other  soldiers  or  co-workers  in 
their  unit.  If  we  can  support  these  several  persons  as  teachers 
or  communicators,  we  will  have  solved  the  three  person  problem, 
and  will  have  assured  that,  in  training,  the  ACTO  definition 
of  communication  as  "a  method  of  transferring  ideas  that  ensures 
understanding  of  meaning  and  intent"  is  indeed  achieved.  The 
problem  of  inadequate  teacher  quality  assurance  discussed  in 
the  last  section  is  solved  by  expanding  the  materials  development 
function  to  include  built-in  training  materials  for  the  NCO 
or  trainer  in  how  to  use  the  packages  that  are  being  sent 
out.  There  is  no  reason  to  expect  that  NCO's  or  trainers  on 
the  job  will  know  how  to  train,  even  given  excellent  materials 
like  the  TEC  lessons  that  have  been  distributed  in  the  past. 

These  have  been  used  by  a  disappointing  portion  of  the  NCO's. 

The  future  assurance  process  should  also  consider  transactions 
between  the  second  and  third  person  after  initial  training 
activities.  After  initial  training  activities  are  conducted 
by  the  NCO's  and  soldiers  in  unit  learning  centers  at  the 
battalion  or  company  level,  these  peopl  -  must  go  out  into 
job  sites  in  repair  bays,  offices,  or  the  field  and  perform 
the  work  they  have  learned.  As  an  extension  of  the  future 
assurance  process,  job  aids  and  guides  should  be  available 
to  them,  for  their  own  work,  and  also  usable  by  them  in  teaching 
one  another  (or  at  least  modeling  correct  job  performance  to 
one  another  )  . 
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Previous  efforts  at  distributed  training  have  been  severely 
criticized  because  of  these  deficiencies  in  being  useful  and 
used  on  the  job.  Insufficient  success  has  been  achieved  in 
training  the  NCO' s  to  use  the  distributed  materials  correctly, 
and  in  assuring  that  "the  water  gets  down  to  the  end  of  the 
row".  Put  another  way,  the  Army  has  not  solved  its  three  person 
problems  in  assuring  that  training  on  the  job  is  correctly 
executed  and  gets  the  desired  results. 

The  feedback  paths  for  assurance  data  are  not  shown  on  the 
diagrams  in  Figures  2-4  and  2-5.  The  feedback  data  paths 
could  be  indicated  on  the  charts  as  electronic  signal  paths 
going  back  from  the  second  and  third  persons  to  the  sending 
agency.  For  materials  improvement,  the  sending  agency  is  the 
TR.4D0C  school,  or  ATSC.  which  reauires  data  or.  the  c f f c rtivcr.c S3 
of  the-  materials  distributed. 

Figures  2-4  and  2-5  can  be  adapted  for  communications  other 
than  training,  and  signal  paths  can  be  depicted  going  back 
to  the  agency  involved.  For  example,  in  the  SPA's  program, 
it  is  important  to  know  whether  the  job  aids  are  functioning 
properly  on  the  job  in  increasing  the  number  of  ready  weapons 
systems  and  decreasing  down  time  and  cost  of  false  or  erroneous 
repairs.  An  important  consideration  in  ACTO's  design  of  new 
information  systems  to  support  these  delivery  systems  must  be 
upstream  feedback  paths  utilizing  network  communications 
technologies . 

The  Need  for  Feedback  Data  to  Assure  That  Messages  and  Training 
"Reach  the  Third  Person  ."  The  reader  might  be  tempted  to 
assume  that  the  symbol  chosen  for  the  work  of  an  organization, 
an  arrow  emerging  from  a  bracket,  implies  one-way  communication. 
This  is  definitely  not  the  intent.  The  implication  is  two-way 
communication.  The  use  of  the  word  "assurance"  in  three  of 
the  delivery  systems  and  "improvement"  in  another  one  implies 
considerable  interest  in  data  to  assure  that  the  mission  of 
each  organization  is  being  accomplished.  To  solve  the  three- 
person  problem,  this  assurance  data  must  be  obtained  from  the 
final  end  users,  symbolized  by  the  second  and  third  person  or 
persons . 


THE  SIX  SCENARIOS  A  NT  THEIR  RELATIONSHIP  TO  THE  FIVE  TYPES  OF 
SUPPORT  SYSTEMS 


In  a  previous  ACTO  study,  "Storace  Media  for  Electronic  Informa¬ 
tion  Delivery  Systems'  (Bunder  son,  Pett  ,  and  Bearnson,  1981), 
six  scenarios  with  several  sub-scenarios  were  described  in  detail. 
These  scenarios,  car.  now  be  grouped  under  the  five  logically 
necessary  delivery  systems  derived  in  the-  last  section.  This 
grouping  is  as  follows: 

1  .  S  cenarios  Needed  for  Phas^-  I  Te  a  oh  i_n  c  _l)  e  1  i  v  e  rv  (  T  R  A  DOC  Sc  ho  cl 

Scenario  3a,  Teaching  Delivers 
any  other  formal  training  fa-.  : 


at  a  TRADOC  Sch- 

:  i :  \  .  . 
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See;  ano  2b.  Where  maintenance  VOS  •  s  are  taught  at  a 
formal  school ,  the  same  SPA's  delivery  system  for  field 
use  could  be  used  during  training.  Soldiers  would 
be  familiar  with  the  maintenance  aiding  equipment  when 
they  went  out  on  the  job.  This  is  a  good  solution  to  the 
three  person  problem.  A  person  already  familiar  with  his 
eventual  tool  would  be  able  to  utilize  it  during  Phase  II 
of  his  career.  He  would  be  able  to  demonstrate  the  correct 
use  of  it  to  others  as  they  came  on  the  job. 

Scenario  3b.  Two-dimensional  simulation  in  the  TRADOC 
schools . 

Scenarios  Needed  i or  Le a r n e r  Quality  Assurance 


Scenario  4.  Electronic  Delivery  System  for  the  recruiter. 

Scenario  5.  Electronic  Delivery  System  Support  for 
Administration  and  On-Line  Testing  at  the  Armed  Forces 
Enlistment  and  Evaluation  Centers. 

Scenario  lb.  On-the-job  learning  using  an  electronic 
delivery  system  to  improve  basic  skills  (e.g.,  BSEP 
program ) . 


3.  Scenarios  Needed  for  Teacher  Quality  Assurance 


This  function  has  no  single  "home”  and  is  not  fully  and 
effectively  implemented  at  this  time.  In  terms  of  electronic 
information  delivery  systems,  it  would  use  the  same  delivery 
systems  used  in  Scenario  3a  at  the  TRADOC  school  during  formal 
teacher  training  activities.  On  the  job,  it  would  use 
distributed  information  delivery  systems  for  NCO  training.  The 
materials  development  delivery  system  must  have  a  significant 
role  in  developing  trainer  training  materials  and  seeing  that 
they  are  packaged  along  with  the  job  training  materials  for 
soldiers.  Otherwise,  this  vital  function  will  continue  to 
be  performed  poorly  or  not  at  all,  as  at  present.  This 
analysis  may  indicate  the  need  for  organization  of  some  propo¬ 
nent  lor  teacher  quality  assurance  on  the  job. 

4.  Scenarios  Needed  for  Materials  Development.  Distribution  and 
Improvement 

Scenario  3a.  Materials  Development  at  the  TRADOC  School-,. 
Also,  general  support  from  ATSC  at  Ft.  Eustis  and  Toby- 
bannah,  and  by  other  Army  organizations  for  developing 
materials  or  managing  contractors. 

5  .  Sc  e  r.  nr  io  s  Nee  d-  d  f  or  Phase-  II  Ira  in  mo  or  Future  Assume  ,j_ 

This  function  reouires  t  lie  most  new  development  because  it  li¬ 
the  one  that  has  been  least  adequately  implement  ed .  Thus,  it 
has  the  most  new  scenarios  assoc  i  at  ec  with  it.  Included  art.  : 

la.  T.v  i.s<-  of  di:-*.  rt;  ut--d  ole.'  r.  i  c  ch.  I  :  vt  v. 
b;.  tv  NCC . 


lb.  The  use  of  distributed  electronic  delivery  sy stern. - 
by  the  individual  soldiers. 

lc.  The  use  of  electronic  delivery  systems  and  portable 
memories  for  management  of  training. 

ld.  The  use  of  distributed  delivery  systems  and  portable 
memories  for  group  training  and  the  ARTEP. 

2a.  The  SPA's  delivery  system  for  maintenance  aiding 
on  the  job. 

2b.  The  SPA's  delivery  system  for  maintenance  job¬ 
training  on  the  job  using  ETK. 

2c.  The  use  of  electronic  delivery  systems  an  i  porta:-'.  • 
memories  for  logistics  control  on  the  job. 

With  but  a  feu  exceptions,  the  detailed  discussion  of  these 
scenarios  is  found  in  chapter  8  of  the  Storage  Media  Report 
(Bunderson,  Pett,  and  Bearnson,  1981,  pp .  113  through  1 g  1  ) • 

This  chapter  has  not  been  revised  for  this  study.  The  chapter 
is  quite  extensive  and  cannot  be  repeated  here.  The  exceptions 
and  changes  to  the  published  discussions  are  as  follows: 

(1)  Scenario  Id  has  been  modified  by  follow-up  investigation 
of  portable  memory  technology.  The  storage  media  project 
showed  that  the  magnetic  stripe  technology  was  not 
adequate  as  a  porta'/ le  memory  for  the  soldier's  training 
and  training  management  records.  However,  three  nev. 
technologies  are  excellent  candidates.  One  is  a  chip  in 
a  card,  the  other  is  a  chip  in  a  rugged  object  like  a 
plastic  key.  and  a  third  is  an  optical  direct  read  after 
write  strip  on  an  I.D.  card.  These  portable  memories  are 
illustrated  in  the  scenarios  shown  in  Chapter  8  of  the 
previous  report.  However,  scenario  Id  was  not  sufficiently 
explicit  in  how  the  NCO  would  obtain  ratings  on  soldier's 
hands-on  component  and  job-site  component  performances  or 
how  the  NCO  would  obtain  quantitive  scores  (at  least  "go" 
and  "no  go")  for  ARTEP  tasks.  The  solution  to  this  problem 
is  to  provide  a  hand-held  prompting  and  scoring  device 
that  the  NCO,  trainer,  or  tester  can  take  into  any  location 
to  observe  manual  performances  by'  individual  soldiers  and 
by  groups.  The  hand-held  device  would  prompt  one  by  one  on 
the  different  tasks  that  were  to  be  performed  and  the  rater 
would  enter  "go'no-go"  or  numerical  ratings  into  the  hand¬ 
held  device.  This  device  might  have  in  it  a  very  small 
reader, writer  for  the  portable  memories  associated  with  tin 
individual  soldiers  or  with  the-  individual  units 
and  these  memories  could  be  updated  instant  Iv.  All  /  rn.v  -  !• 
the  hand-h'ld  prompting  rating  device  could  be  simpler.  1 
could  keep  t  tie  record-  1  r,  ai.  internal  me-morv  which  ceu ;  c: 
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later  be  read  into  a  work  station.  When  the  portable 
memory  (e.g.,  I.D.  card  with  memory)  belonging  to  the 
individual  soldier  or  the  unit  leader  was  later  read 
into  the  work  station,  it  could  be  updated. 

(2)  Scenarios  lb  and  lc,  which  describe  how  the  soldier  uses 
job-training  discs  to  obtain  individual  training,  needs 
to  be  updated  in  a  minor  way  as  a  result  of  the  analysis 
of  the  Learner  Quality  Assurance  delivery  system.  In 
addition  to  job  training  discs  and  interactive  programs, 
BSEP  materials  could  be  implemented  for  delivery  on-the- 
job.  This  requires  no  changes  in  the  procedures  for 
scenario  lb,  but  requires  that  BSEP  be  integrated  into 
the  Plan  for  Continuing  Individual  Training  in  Units 
(PCITU)  discussed  in  scenario  lc. 

(3)  Another  scenario  that  needs  elaboration  is  that  of  the 
electronic  office.  The  important  elaboration  is  to 
consider  the  requirements  of  command  and  control  for 
force  commanders.  The  important  consideration  is  whether 
special  provisions  must  be  made  for  the  administrative 
and  control  activities  associated  with  command  and  contro 
hardware  and  software  in  the  commander's  office,  whether 
in  a  garrison  or  in  the  field. 

The  Role  of  the  Memory  Card  in  All  Scenarios 

The  concept  of  a  portable  memory  card  (or  small  object 
containing  a  memory  1  has  considerable  significance  to  all  of 
the  scenarios.  There  are  two  reasons  for  the  importance  of 
this  concept  : 

1.  The  portable  memory  and  I.D.  card  can  serve  as  the 
"key"  to  unlock  the  system  and  in  so  doing,  can 
provide  assurance  data  on  utilization  and  performance 
This  data  can  be  summarized  and  utilized  by  higher 
commands . 

2.  The  portable  memory  makes  possible  the  distributed 
network  in  which  all  of  the  work  stations  in  an 
area  can  be  stand  alone.  No  "wiring  up"  is  required 
since  data  can  be  transferred  from  work  station 

to  work  station  manually  on  the  cards. 

1.  The  card  as  "key"  o  the  system.  Using  a  small  port ab It 
memory  as  a  way  of  obtaining  access  to  any  station  has  sevtra . 
advantages.  First,  it  reduces  input  errors.  Entering  th< 
social  security  number  or  some  other  code  number  or  name 
car.  be  time  consuming  and  error  prone.  The  card  contains 
all  identifying  information  for  any  user.  A  short  password 
or  passcode  can  be  associated  with  it  for  security  if  necessar 
but  in  either  case,  access  to  the  system  is  greatly  simplified 
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Second,  since  the  card  contains  an  updated  version  of  the 
soldier's  training-  information  and  history,  this  and  the  current 
transactions  can  be  logged  in  the  non-volatile  memory  of  each 
work  station.  Ihis  is  an  unobtrusive  way  to  collect  data 
on  utilization  of  a  system.  Whether  or  not  the  utilization  is 
achieving  good  results  can  be  determined.  This  for  the  first 
time  makes  training  accountability  a  possibility.  Third, 
frequent  insertions  of  the  I .D.  card  into  each  work  station 
allows  back  up  copies  of  the  soldier's  record  to  be  made  from 
time  to  time.  This  provides  security  in  the  event  of  loss 
or  destruction  of  the  card. 

Figure  2-6  illustrates  the  l.D.  and  portable  memory  card  as 
the  "key"  to  unlock  the  system.  Figure  2-7  illustrates  three 
promising  technologies  that  should  be  explored  for  use  as  the 
portable  memory.  The  l.D.  card  with  chip  in  it  is  illustrated 
at  the  right  side  of  Figure  2-7.  The  chip  is  stored  under 
the  small  circular  contact  plate  in  the  upper  right  hand 
corner  of  the  card.  Tape  bonding  techniques  are  now  available 
to  package  integrated  circuit  chips  in  standard-sized  credit 
card  plastic  stock.  The  object  in  the  center  is  a  commercially 
available  "data  key."  The  key  is  inserted  into  an  inexpensive 
receptacle  and  turned  to  engage  the  portable  memory.  The 
key  is  quite  rugged  and  could  be  included  on  the  dog  tag 
chain  or  a  key  ring  in  the  soldier's  pocket. 

The  third  competing  technology  is  depicted  at  the  far  left 
of  the  figure.  The  Army  has  already  decided  to  use  the  magnetic- 
stripe  technology  on  an  l.D.  card.  This  is  inadequate  for  the 
purposes  discussed  herein.  However,  a  new  technology,  the 
optical  strip,  developed  by  Drexler  Industries,  is  a  candidate 
technology.  This  strip  could  be  distributed  on  the  same  card 
as  the  magnetic  stripe  but  would  use  a  different  reader  with 
a  laser.  The  laser  would  burn  microscopic  pits  in  the  optical 
strip  as  new  information  had  to  be  accumulated.  This  is  a 
non-erasable  medium  and  would  not  be  subject  to  damage  by 
magnetic  fields.  The  record  is  permanent.  There  is  so  much 
storage  space  available  (about  3.6  million  bytes)  that  the 
card  could  be  used  for  a  long  time  before  it  would  have  to 
be  replaced  with  a  new  card  (or  a  new  strip  on  the  same  card). 

2.  Portable  memories  reduce  network  requirements .  Since  each 
soldier  carries  his  own  training  record  on  a  portable  memory, 
there  is  a  way  around  "hard  wired"  local  networks.  These  may 
not  be  feasible  in  some  military  locations.  Stand-alone 
work  stations  will  do  the  job  so  long  as  they  are  each 
equipped  with  their  own  secondary  storage,  such  as  floppy 
disks,  bubble  memory,  or  Winchester  disks.  Figure  2-8 
depicts  an  N'CO  who  has  gathered  the  cards  from  his  own  squad, 
or  in  the  case  of  a  company  commander,  from  his  platoon  leaders. 
He  is  about  to  read  them  into  an  administrative  station  so 


that  he  can  summarize  the  records  from  this  lower  level  of 
command.  His  commander  in  turn  can  request  access  to  his  card 
to  read  it  into  another  work  station  for  yet  higher  level 
summaries.  If  the  card  reader  is  available  at  each  work 
station  anyway  for  the  reasons  described  in  (1)  above,  then 
this  additional  option  is  available.  This  would  have  some 
advantages  when  only  a  few  stand-alone  work  stations  are 
available  at  a  reserve  center  or  a  National  Guard  center  or 
some  field  location. 

Summary  of  Scenario  An alvei s 

This  chapter  has  so  far  presented  an  analysis  of  the  ACTO 
mission  into  a  three-person  problem,  for  communication  and 
training,  and  showed  the  five  types  of  teaching  support  systems 
needed  to  solve  the  problem.  Two  of  these  five  functions, 
Teacher  Quality  Assurance  and  Phase  II  Training  or  Future 
Assurance  have  not  been  adequately  implemented  yet  in  the 
Army.  One  of  the  major  reasons  for  this  lack  of  successful 
implementation  has  been  the  limits  of  the  current  delivery 
system.  The  distribution  of  printed  materials  and  hard  copy 
audio-visual  materials  is  not  sufficient  to  implement  these 
delivery  systems  in  a  proper  manner.  It  must  be  possible  to 
replicate  interact  ions .  These  interactions  can  prompt  and 
guide  SCO's  in  how  to  train,  and  can  prompt  and  guide  soldiers 
through  training  activities,  maintenance  aiding  activities, 
logistics  aiding  activities,  etc.  The  new  technologies  of 
computer  chips  and  mass  portable  memories  make  it  possible  that 
interactions  and  data  can  be  replicated  and  distributed  to  the 
job  sites.  Thus,  it  is  only  recently  that  there  has  been  an 
opportunity  for  adequate  teacher  quality  assurance  and  future 
assurance  activities  to  take  place. 

In  fulfilling  its  mission,  ACTO  must  not  only  define  the 
technology  portions  of  these  new  delivery  systems  (and  of  the 
three  established  delivery  systems);  ACTO  must  also  consider 
the  roles  of  the  people  and  the  new  traditions  (both  written 
and  unwritten)  which  must  be  established  to  accomplish  their 
mission  of  "transferring  ideas  in  a  way  that  ensures  under¬ 
standing  of  meaning  and  intent."  By  basing  this  analysis  on 
the  three-person  problem  for  communication  and  for  teaching, 
it  is  shown  how  ACTO '  s  mission  can  be  accorr.pl  ished .  Thus, 
the  new  electronic  delivery  systems  being  designed  by  ACTO, 
augumented  by  "soft  technology"  approaches  to  fit  the  systems 
with  the  people  and  traditions,  can  be  sufficient  to  the 
entire  need. 
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The  set  of  required  scenarios  can  be  analyzed  against 
the  different  types  of  hardware  devices  to  find  a  minimal 
modular  set  of  components.  Then  the  presentation  features 
of  that  minimal  set  of  components  will  be  elaborated,  studied, 
and  recommendations  made  in  the  remainder  of  the  report. 


BASIC  SYSTEM  TYPES  REQUIRED  BY  THE  SCENARIOS 

In  order  to  determine  the  presentation  features  required  by 
each  of  the  scenarios  presented  above,  a  careful  analysis 
of  each  scenario  and  sut -scenario  was  undertaken.  A  matrix  of 
sub-scenario  by  candidate  features  was  prepared.  It  quick! \ 
became  obvious  that  there  is  a  great  deal  of  overlap  in  the 
basic  system,  types  across  the  scenarios.  For  example,  an  NCO 
at  a  battalion  learning  center  who  is  receiving  refresher 
training  would  need  features  identical  to  those  of  a  student, 
another  example,  the  NCO  in  a  battalion  learning  center  who  is 
registering  students  would  need  the  same  capabilities  as  an  NCO 
at  a  TRADOC  school  who  is  performing  the  same  function.  The 
pattern  of  candidate  features  was  roughly  grouped  into  five  r.aj 
system  types. 

This  grouping  is  summarized  in  Table  2-1.  The  five  types  of 
delivery  systems  are  listed  as  column  headings.  Three* of  the 
system  types  are  all  variations  of  the  basic  electronic 
delivery  system  for  use  in  a  sheltered  environment.  Thus 
economy  of  scale  could  be  gained  by  having  the  same  basic 
CPU,  memory,  and  communication  hardware  and  software  and  plug¬ 
ging  in  different  display,  response,  and  mass  memory  devices* 
as  needed.  The  militarized  electronic  delivery  system  must 
be  rugged  and  portable.  It  car.  be  used  for  job  aiding  and  also 
occasionally  for  training,  using  Extension  Training  .Materials 
( ETM) .  Because  of  its  portability  and  ruggedness  it  might  be 
used  in  a  variety  of  training  or  job  aiding  applications  where 
a  portable  rugged  workstation  is  required.  An  example  is  the 
testing  and  enlistment  processing  scenario.  Testing  takes 
place  at  mobile  evaluation  team  sites  that  are  rented  temp¬ 
orarily  for  ASVAB  testing. 

The  row  heading.-  in  Table  2-]  are  th<  various  scenario-  and 
sub-scenarios  grouped  under  five  kinds  of  orcanizut ionai 
functions  explained  ir,  this  chapter.  Either  an  X  or  a  quest  ior. 
mark  is  indicated  in  each  row  under  the  appropriate  column. 

A  single  X  in  a  rov;  means  that  the  functions  required  in  th* 
scenario  can  be  fully  met  by  the  one  support  system  marked. 

If  a  question  mark  is  indicated  in  other  columns  this  mean.' 
that  a  requirement  exists  for  t  he  functions  to  sometimes  tan- 

place  via  a  support  system  other  than  the  primary  one.  For 
example,  for  scenario  5,  testing  and  enlistment  processing, 
the  office  administration  system,  a  monochromatic  graphics  and 


Table  2-1 

FIVE  ELECTRONIC  DELIVERY  SYSTEMS  REQUIRED  BY  THE  SCENARIOS 


SCENARIO 


PHASE  I  TEACHING  DELIVERY _ 

3a  Tea  chine  at  School 


2b  Teaching  on  Units  to  | 
be  used  in  the  field 


EIDS  WORK  STATIO 
(SHELTERED  ENVIRON 

NS 

WENT) 

miss - 

(RUGGED,  PORTBL) 

HAND-HELD 

1  . 

TRAINING 

2.  OFFICES 
&  ADMIN. 

3. 

AUTHORING 

4.  JOB  AIDING 
&  OTHER  ETM 

5.  SOT  & 
ARTS'3.  ETC 

lb  Upgrading  Basi  c 
Skills  on  the  Jo 


TEAChtR  QUALITY  ASSURANCE 


Teach 

any 


MATER IAL S  DEVELOPM 


3b  Authoring  at  TRADOC 
School s  ,  ATSC  .  Etc 


FUTURE  ASSURANCE 


la  NCO  Use 


1  b  Sol  di er  Use 


1c  Management  o 
Train inc 


2a  Maintenance  Aidin 


2b  SPA's  ETM 


2c  Logistics  Control 
6 a  Electronic  Office 
6t  Command  and  Control 


character  display  terminal  is  sufficient  to  meet  all  of  the 
requirements  specified  by  the  Navy  for  a  system  they  wish  to 
procure.  However,  the  training  workstation  with  attached 
videodisc  could  introduce  some  more  realistic  kinds  of  tests 
in  the  future.  Also,  the  portability  and  ruggedness  of  the  milita 
rized  terminal  (which  also  has  a  monochromat i c  graphics 
display)  would  be  suitable  for  transport  to  the  Mobile 
Evaluation  Team  sites  for  testing.  For  other  rows  more  than 
one  X  is  marked.  This  means  that  the  function  required  by  the 
scenario  needs  to  take  place  on  more  than  one  of  the  delivery 
systems.  For  example,  the  function  of  teacher  quality  assurar.ee 
is  applicable  to  every  delivery  system.  In  every  case  there 
are  supervisors  ana  workers  who  must  learn  to  use  the  delivery 
system..  Wn-r  never  supervisors  are  placed  ir.  the  role  oi 
trainers  then  the1  teacher  quality  assurance  function  is 
important.  The  delivery  systems  should  have  some  self  -teaching 
and  sel 1 -prompt i ng  functions  built  in  to  them  to  assure  that 
supervisors  can  easily  train  new  people  in  the  operation  of 
the  equipment.  Another  area  where  more  than  one  X  is  marked 
is  in  the  management  of  training.  Ratings  of  individual  and 
group  performances  in  the  field  must  take  place  on  the  hand¬ 
held  unit.  However,  data  collected  in  the  hand-held  device 
from,  this  field  activity  must  be  transferred  back  into  either 
an  administrative  terminal  at  the  company  or  battalion  level 
or  into  the  platoon  or  company  level  workstations  used  for 
training.  Further  detail  on  each  of  the  five  delivery  system, 
types  is  presented  below. 

Delivery  System  1.  Instruction  in  a  Sheltered  Environment 


Figure  2-9  depicts  this  system,  type.  Two  soldiers  are  shown 
working  independently  at  each  of  two  workstations  with  attached 
videodisc  players  and  keypads.  One  of  the  soldiers  might  be 
studying  job  training  materials,  another  might  be  taking  an 
SOT  lest,  either  for  practice  or  for  the  record.  A  small 
group  of  five  soldiers  is  shown  working  around  the  same  work¬ 
station  with  one  of  them  controlling  it  by  means  of  remote 
control  keypad.  An  NCO  is  shown  assisting  an  individual  solcie 
by  showing  him;  an  actual  piece  of  equipment  that  is  being 
simulated  on  the  workstation.  These  workstations  nay  be 
equipped  with  their  own  magnetic  memories,  or  may  share  a 
larger  magnetic  memory,  as  shown  in  the  figure.  Other 
peripherals  may  be  shown,  such  as  a  printer  for  administrative 
and  communication  purposes.  This  system  would  be  utilized 
in  a  TRADOC  school  and  also  in  the  garrisoned  units,  and  ir. 
learning  centers  at  the  appropriate  level. 


De  1  i  very  Svst  f-m  _2  . 
Environn-  nt 


A  am.  :r.  istrat  i  on  ...a  n  a  c-m. 


ir.  a  Shelter-::; 


["his  sys-t  <-m.  is  depicted  ir.  f  inure  2-10.  A  videodisc  player 
is  not  required  i  r.  this  application  and  a  color  display  n 
lot  a  1  wavs  rerju  l  red  .  a  1 1  hough  it  won  1  d  b*.-  desirable,  c-sr-oc :  a  1 
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in  command  and  control  situations.  One  of  the  options  to  the 
administrative  terminal  is  the  printer  shown  depicted  in 
figure  2-10.  The  administrative  terminal  has  application  in 
numerous  scenarios. 

Delivery  System  3.  The  Authoring  System 

The  main  authoring  terminal  should  be  the  same  as  the  regular 
Delivery  System  1  terminal  but  with  more  options.  That  is, 
in  addition  to  the  videodisc  player  and  the  color  display,  a 
full  keyboard  should  be  provided  and  a  variety  of  other  input 
devices  corresponding  to  the  devices  that  will  be  on  the  EIDS 
terminals  for  which  the  materials  are  being  prepared.  Som.e 
kinds  of  authoring  only  require  the  administrative  terminal. 
Indeed,  it  can  be  said  that  in  the  electronic  office  scenario 
where  communications  are  being  prepared  to  be  sent  elsewhere, 
a  kind  of  "authoring”  takes  place.  Thus  the  features  of  the 
authoring  terminal  could  leverage  greatly  the  work  of  those 
preparing  the  communications.  The  communications  could  be 
prepared  in  forms  other  than  straight  print,  requiring  some 
graphics  capabilities  to  speed  communications,  lower  the  number 
of  pages,  and  reduce  reliance  on  the  written  word. 

No  illustration  is  provided  for  the  authoring  station,  but  the 
basic  processing  and  communication  components  would  be  the  same 
as  those  illustrated  for  the  training  and  administrative 
delivery  systems. 

Delivery  Svstem  4.  Job  Aiding  in  the  Field 


This  delivery  system  is  illustrated  in  Figure  2-11.  It  is 
packaged  in  a  small  attache  case- sized  unit.  A  flat  panel 
monochromatic  graphics  display  is  visible.  A  hand-held  remote 
control  keypad  communicates  with  the  system  to  call  out  the 
pages  of  SPA's  material  to  aid  in  the  particular  maintenance  task. 

Delivery  Svstem  5.  The  Hand-Held  Record  Keeping  System 

Figure  2-12  shows  an  NCO  rating  each  of  the  sub-tasks  on  an 
ARTEP  as  soldiers  in  his  unit  perform  one  of  the  sub-tasks. 

The  hand-held  unit  must  be  capable  of  displaying  short  prompts 
to  the  NCO  that  guide  him  in  the  sub-task  being  rated.  This 
same  hand-held  unit  could  be  used  for  inventory  and  logistics 
control  applications.  The  soldier  using  it  would  be  prompt ec 
by  statements  to  locate  and  identify  certain  items  and  would 
enter  the  number  found  into  the  local  memory. 

Together,  these  live  system  types  were  found  to  encompas- 
virtually  all  of  the  candidate  features  for  the  scenarios 
which  are  described  in  the  storage  media  report,  and  as  aucm*.  r.t  ed 
herein.  These  five  system  types  art-  used  in  the  cost  analysis 
reported  ir,  chapter  8. 


CHAPTER  3 


INSTRUCTIONAL  DESIGN  CONSIDERATIONS  FOR  PRESENTATION  FEATURES 


This  chapter  will  present  subsections  for  each  of  the  following 
major  presentation  feature  topics: 

I.  Visual  Elements  and  Graphics 

II.  Color,  Shading  and  Gray  Scale 

III.  Motion,  Animation  and  Still  Frames 

IV.  Sound  and  Voice  Input  and  Output 

V.  Interaction  Processes 

For  sections  I  —  1 1 1  the  results  of  several  major  reviews  are 
summarized.  These  reviews  concern  the  use  of  visual,  graphic,  col 
and  motion  presentation  features.  The  reviews  are  Dwyer,  1971, 
197S,  I960;  Gulliford,  1973;  Merrill  and  Bunderson,  1979;  and 
Moore  and  Nawrocki,  1978.  A  summary  statement  is  presented  first 
for  each  section,  followed  by  the  guidelines  and  the  supporting 
research. 

SECTION  I.  VISUAL  ELEMENTS  AND  GRAPHICS 


The  major  point  from  the  reviews  on  realism  and  visual  elements  is 
that  mean i n gf u 1  ness  is  more  important  than  real i sm--hand  sketched 
line  drawings  which  highlight  critical  points  can  be  as  effective 
as  detailed  colored  pictures.  The  critical  factor  appears  to  be 
the  match  between  the  ,  raphic  and  the  learner's  relevant  knowledge 
Simple  line  drawings  . e  appropriate  for  those  who  are  new  to  a 
subject  area  and  are  being  externally  paced  through  instruction 
(e.g.,  by  a  videotape).  Too  much  detail  in  too  little  time  can 
impede  learning  by  obscuring  the  major  points.  Conversely,  for 
learners  who  are  already  experienced  in  the  content  area,  who  are 
visually  literate  in  graphics  conventions,  and  who  can  self-pace 
at  their  own  speed,  more  detail  gives  real  world  experience 
finding  critical  features  on  their  own.  In  this  case  more  realist, 
is  appropriate  . 

•  Visualization  containing  too  little  or  too  much  realistic  dc-tai 
may  lead  to  negative  motivation  on  the  part  of  the  student. 
Effective  visualization  contains  sufficient  information  to 
encourage  active  student  participation  without  simultaneously 
interfering  with  his /'her  attending  to  the  stimuli  (Dwyer,  1980) 

•  The  array  of  different  types  of  available  visualization  reprv-s/ 
increasing  degrees  of  realistic  detail  (from  line  drawings  to 
realistic  photographs).  Excessive  realism  in  a  visual  mat 
impede  rather  than  facilitate  optimum  student  achievement  --t 
visual  may  contain  so  many  stimuli  that  the  students  arc  una:  3-. 
to  focus  their  perceptual  energies  long  enough  or  clearly 
enough  to  engage  in  the  kind  of  interaction  necessary  for  th- 
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desired  kinds  of  learning  to  occur.  Consequently,  a  photograph 
of  an  object  or  situation  may  present  a  "perfect"  image  of 
reality  but  may  fail  to  clearly  illustrate  that  part  of  the 
message  to  be  communicated  (Dwyer,  1980). 

•  Different  types  of  visuals  (containing  varying  amounts  of 

realistic  detail)  can  provide  the  learner  with  the  same  informa¬ 
tion  without  providing  the  same  amount  of  stimulation. 
Consequently,  two  different  types  of  visuals  may  have  the  same 
inst ruct ional  potential  for  facilitating  student  achievement. 
Operationally  then,  differences  in  the  amount  of  realistic 
detail  contained  in  visuals  has  to  make  a  difference  to  be  a 
difference.  Visuals  are  functionally  identical  if  they  are 
indistinguishable  in  terms  of  improving  student  achievement 
( Dwyer ,  1980). 


9  The  process  of  simplifying  or  editing  realistic  detail  from 
visuals  may  reduce  or  eliminate  important  characterist ics 
prerequisite  for  learning  to  occur.  It  must  be  possible  to 
distinguish  relevant  from  irrelevant  aspects  of  an  object  or 
situation.  An  edited  visual  may  provide  a  too  narrow- 
perspective  of  reality  where  the  student  is  less  able  to 
recognize  necessary  patterns  essential  in  making  meaningful 
interpretations.  Editing  or  simplifying  realistic  detail  beyond 
a  certain  point  does  not  lead  to  uniformity  of  perception 
(Dwyer,  1980,. 

#  The  relationship  between  the  amount  of  realistic  detail  in 
visuals  and  student  achievement  is  curvilinear  rather  than 
linear.  There  are  points  beyond  which  increases  in  the  amount 
of  visual  stimuli  in  visuals  impedes  rather  than  facilitates 
learning.  For  this  reason  the  amount  of  stimuli  in  visuals 
should  probably  be  thought  of  in  optimal  rather  than  maximal 
terms.  There  is  an  optimal  level  beyond  which  adding  additional 
realistic  detail  provides  no  further  increases  in  learning. 
(Dwyer,  1980) 

•  The  advantages  and  disadvantages  inherent  in  different  types 
of  visuals  need  to  be  identified  and  isolated  functionally  in 
relation  to  their  relative  contributions  in  facilitating 
specific  kinds  of  learning.  Only  when  this  has  been  achieved 
it  is  possible  to  effectively  manipulate  and  integrate 

the  different  types  of  visual  materials  to  ensure  that  the 
ones  being  used  are  the  ones  which  will  produce  optimum 
learning.  (Dwyer,  1980) 

•  The  realism  continuum  for  visual  illustrations  is  not  an 
effective  predictor  of  learning  efficiency  for  visualized 
instruction  which  is  externally  paced.  (Dwyer,  1978' 

0  Visual  illustrations  containing  different  amounts  of  realistic 
detail  can  transmit  the  same  amount  of  information  without 
providing  the  same  amount  of  visual  stimulation.  (Uw\ei  ,  be  m 
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•  To  reduce  the  effects  of  individual  differences  in  learning 
from  visualized  instruction  both  simple  and  detailed  line 
drawings  are  more  effective  than  photographs.  (Dwyer,  1978) 

•  The  instructional  effectiveness  of  a  specific  type  of  visual 
is  related  to  the  number  of  relevant  cues  present--ei ther  too 
many  or  too  few  cues  affect  learning  adversely.  (Dwyer,  1980) 

•  Simplified  line  drawings  are  often  more  effective  than 
complex  photographs  for  instructional  purposes.  (Moore  and 
Nawrocki ,  1978) 

,  A  line  drawing  appears  to  be  as  good  as  a  realistic 
presentat ion . . . us i ng  line  drawings  to  represent  items 
results  in  faster,  longer  retained  learning.  Increasing 
realism  in  a  visual  does  not  always  cause  a  significant 
increase  in  learning.  Since  we  learn  from  the  boundaries  of 
shape,  providing  total  realism  seems  to  be  unnecessary... 

A  learner  should  not  have  to  discriminate  between  relevant 
and  irrelevant  details.  (Gulliford,  1973) 

•  Graphics  are  not  necessary  and  may  actually  be  distracting 

if  they  are  used  as  signs  for  concepts,  objects  or  events  with 
which  the  learner  has  had  considerable  previous  experience. 
Under  such  conditions,  the  added  external  visual  or  graphic 
is  redundant  with  the  learner's  mental  visual  image,  and  thus 
may  not  facilitate  performance.  Graphics  become  helpful  and 
vital  when  the  learner  is  exposed  to  new  concepts,  objects, 
or  events  for  which  he  has  no  labels  and/or  corresponding 
visual  images.  (Merrill  and  Dunderson ,  1979) 

•  Pictures,  colcr ,  realism,  and  motion  generally  increase  the 
attraction  and  interest  value  of  materials,  are  preferred  by 
learners  of  all  ages,  and  may  significantly  reduce  attrition 
from  training  courses.  (Merrill  and  Bundersion,  1979) 

•  Simple  line  drawings,  color  or  black  and  white,  appear  to 
be  the  most  effective  type  of  graphic  for  increasing 
achievement.  (Merrill  and  Bunderson  ,  1979) 

Method  of  Presentation 

•  There  is  a  relationship  between  how  visualization  is  presented 
to  students  and  amount  of  student  learning  that  will  occur. 

The  types  of  visuals  most  efficient  and  suitable  for  the  rapid 
transmission  of  information  (externally-paced  instruction)  are 
not  the  ones  most  effective  in  facilitating  optimum  amounts  of 
information  in  a  self-paced  instructional  format.  Simplified 
line  drawings  (black  and  white  and  color)  were  more  effective 
for  rapid  transmission  of  externally  paced  instruction.  Coloro 
realistic  photographs  were  most  effective  for  self-paced 
instruction  (Dwyer,  I960). 

•  When  complex  visuals  are  used  in  the  instructional  process, 

the  student  needs  adequate  time  to  make  the  pm  perceptual 

discriminations  (Dwyer,  1980;. 


Level  of  Educational  Obi e c t  1 v e 


•  No  single  type  of  visual  can  be  identified  as  being  most 

effective  in  facilitating  student  achievement  of  all  kind.-,  of 
learning  objectives.  Many  of  the  conditions  of  learning  are 
specific  to  a  particular  medium,  to  a  specific  type  of 
educational  objective,  to  a  particular  rvpe  of  student,  etc. 
(Dwyer,  1980) 


•  There  are  some  types  of  learning  tasks  for  which  increased 
learning  cannot  be  enhanced  by  the  use  of  visuals  (e.g., 
verbal  information).  (Dwyer,  1980) 


Visual  Testing 


a  When  visualized  instruction  has  been  properly  designed  and 
employed,  visual  testing  provides  a  more  reliable  and  valid 
assessment  of  the  students’  level  of  content  acquisition. 
(Dwyer,  1980) 

Individual  Differences 


,  Specific  individual  difference  variables  are  important 

instructional  variables  (age,  1.0.  ,  prior  experience,  reading 
comprehension)  which  determine  the  effectiveness  of  different 
types  of  visualization.  For  example,  learners  being  exposed 
to  a  new  content  area  would  profit  optimally  from  line 
drawings  whereas  individuals  more  familiar  with  the  content 
area  would  profit  from  the  more  realistic  types  of  illustration 
(Dwyer,  1980) 

•  Some  types  of  visuals  (e.g.,  simple  line  drawings)  are  effect iv 
over  a  wide  range  of  audiences,  methods  of  utilization  and  type 
of  educational  tasks.  (Dwyer,  I960) 

#  There  are  individual  preferences  and  learning  abilities 
for  visual  and  verbal  modes  of  instruction.  (Moore  and 
Nawrocki ,  1978) 

Learning  Preferences 


•  Visuals  and  color  are  generally  preferred  to  black  and 
white.  (Moore  and  Nawrocki.  1978) 

,  Visual  multi  media  systems  car,  reduce  attrition.  (Moore  and 
Nawrocki ,  1P78 ; 

•  A  learner  control  system  which  allows  students  to  select 
that  treatment  which  would  be  most  appropriate  for  them  at  a 
giver,  point  of  time  may  be  more  effective  than  assigning 
students  with  different  abilities  to  a  small  number  of  altcrnat 
treatments.  (Merrill  and  Gunderson .  1978' 


Attention  and  Cueing 


#  The  ability  to  focus  one  '  s  at  tent i on  on  relevant  cues  in  a 
learning  situation  is  fundamental  to  all  learning.  For 

a  visualized  presentation  to  achieve  maximum  instructional 
effectiveness  efforts  have  to  be  expended  initially  to 
attract  the  student's  attention  and  then  to  sustain  the 
attention  over  extended  periods  of  time.  (Dwyer,  1978) 

•  Maximum  learning  from  a  visualized  presentation  may  depend 
on  the  judicious  juxtaposition  of  several  different  types 
of  cueing  techniques  rather  than  the  simple  nature  of  the 
visual  stimuli  contained  within  the  visualization  itself. 
(Dwyer,  197S) 

Instructional  Content 


•  Visuals  are  better  than  verbal  stimuli  for  recognition 
and  recall  tasks.  (Moore  and  Nawrocki ,  1978) 

•  Visuals  and  color  are  useful  when  the  learning  task  requires 
a  visual  or  color  based  response.  (Moore  and  Nawrocki.  1978) 

I nst ruct i onal  Design 


•  The  relationship  of  the  turning  of  occurrence  of  (instructional) 
events  is  of  more  crucial  importance  for  effective  learning 
than  beautifully  prepared  materials.  (Gulliford.  1973) 

•  The  general  conclusion  that  emerges  is  that  more  often  than 
not.  there  is  no  learning  advantage  to  be  gained  by  a  fancier, 
more  complex  treatment.  (Guiliiford,  1973) 

•  Interactive,  dynamic,  computer  graphics  offer  a  unique  but 
largely  unknown  training  application  potential.  (Merrill  and 
Bunderson,  1978) 

Bretz  (1971)  has  identified  four  guidelines  for  determining 

whether  or  not  to  use  visualization  in  instruction; 

•  Is  visual  recognition  and  identification  of  objects,  signs 
or  symbols  other  than  language  symbols  an  objective  of  the 
lesson  or  required  for  job  performance? 

•  Is  the  recognition  or  recall  of  a  procedure,  the  physical 
actions  or  positions  of  which  are  unfamiliar  to  the  learner, 
one  of  the  objectives  of  the  lesson0 

•  Is  the  understanding  of  two-dimensional  physical  or  spatial 
relationships  an  objective? 

•  Is  the  recall  or  recognition  of  the  three  dimensional  structur- 
of  some  physical  system  or  object  required? 


Merrill  and  Bunderson  (1979)  also  provide  the  following  specific 
guidelines  for  various  types  of  training  objectives: 


•  Rule  learning  and  using.  The  learning  of  complex  procedural 
rules  can  be  facilitated  through  the  use  of  representations 
such  as  flow  charts  which  graphically  portray  the  order  of  the 
operations  of  the  procedure  and  alternate  paths  which  could 
be  taken  at  decision  points. 

,  Classi fying.  Pictorial  graphics  should  be  used  as  examples  of 
concepts  which  have  concrete  referents.  In  the  initial  stages 
of  training,  simplified  pictorial  graphics  should  be  used  in 
order  to  isolate  and  highlight  critical  attributes.  Later 
stages  of  training  could  employ  more  realistic  graphics  in 
order  to  facilitate  transfer  to  the  real  world  environment  or 
t  ask . 


•  Identifying  symbols.  Considerable  drill  and  practice  with 
corrective  feedback  using  graphics  of  actual  symbols  may  be 
required  in  order  to  learn  adequately  how  to  identify  symbols. 

•  Detect i ng .  The  training  of  detecting  behavior  should  involve 
the  presentation  of  graphics  within  significant  blocks  of 
time  and  space  which  are  realistic  in  terms  of  both  the  object 
itself  ar.d  the  natural  noise  of  the  environmental  setting. 

•  Makinc  decisions.  Training  in  decision  making  should  involve 
instruction  in  the  use  and  interpretation  of  various  numerical 
relationships  represented  in  both  tabular  displays  and  figural 
graphics . 

•  Recalling  bodies  of  knowledge  and  using  verbal  information  . 

A  graphical  representation  of  the  relationship  between  various 
facts  and  ideas  can  provide  organization  and  -rung  which 
may  facilitate  the  storage  and  retrieval  of  verbal  information 
Pictures  or  line  drawings  inserted  in  textual,  verbal  informa¬ 
tion  often  have  no  effect  on  perf ormance  since  they  only 
illustrate  concepts  which  could  have  been  readily  visualized 
from  the  textual  description. 

,  Performing  gross  motor  skills.  The  demonstration  oi  a  complex 
motor  skill  in  real  time  may  be  too  fast.  However,  sb.a  motion, 
could  demonstrate  the  continuity  of  the  movements  while 
permitting  critical  aspects  to  be  perceived.  A  videotape  of 
a  trainee's  motor  skill  performance  may  be  a  very  valuable 
feedback  device. 

•  Steering  and  guiding-continuous  movement.  G  rapines  used  tc 
present  tne  relevant  cues  for  steering  and  guiding  behavior 
should  have  a  high  relationship  to  real  world  noise  and  t im- 
conditions  in  the  later  stages  of  training. 

0  Recall  ir.c  procedures,  positioning  movement,  If  the  procedur* 
to  be  learned  involves  the  assembly  or  disassembly  of  a 
piece  of  equipment  with  mant  parts,  then  graphics  would  be 
necessary  to  show  the  various  parts  of  the  equipment  ar.d 
their  relationship  to  each  other. 


•  Voice  communicat  i_ng .  In  general,  graphics  would  not  be 
necessary  in  the  training  of  voice  communicating  behavior. 

#  Attitude  learning.  Human  modeling  seems  to  be  the  most 
applicable,  and  probably  the  most  effective  approach  for 
attitude  learning.  Attitude  learning  involves  the  imitation 
of  a  credible  and  respected  human  model's  choices  of  action. 

A  human  model  may  be  presented  in  several  ways:  appearing  in 
person,  in  pictures,  in  movies  or  TV,  or  merely  described 
as  in  a  novel,  history  text,  or  biography. 

1.2  SUPPORTING  RESEARCH  OX  VISUALS  AND  GRAPHICS 
Realism  in  Learning 

A  major  issue  in  the  media  literature  is  whether  greater  degrees 
of  realism  in  the  presentation  improve  learning.  Francis 
Dwyer  (1971,  197S)  has  conducted  a  systematic  and  exhaustive 
study  of  this  issue.  The  results  of  his  work  suggest  that  realism 
does  not  necessarily  improve  learning  performance  and  that  simple 
line  drawings  are  sometimes  superior  to  photographs  or  a  detailed 
line  drawing.  Other  research  studies  have  also  shown  that  less 
realistic  visuals  are  often  very  effective  in  instruction  and 
training  (Borg  and  Schuller,  1979,  Wicker,  1970;  Paivio,  Rogers, 
and  Smythe,  1968;  Morgan,  1971;  Wheelbarger,  1970;  Hagaman ,  1970; 
Gorman  ,  19  73 ) . 

A  study  by  Borg  and  Schuller  (1979)  illustrates  this  point  in 
the  context  of  TEC  lessons.  Borg  and  Schuller  compared  the 
achievement  and  attitudes  of  Armor  Crewmen  ( MOS  113)  on  two  versions 
of  a  lesson  for  tank  boresighting.  One  version  was  the  original 
TEC  lesson  and  the  second  was  prepared  with  much  simpler  graphics. 
The  results  showed  that  there  was  no  difference  in  terms  of 
either  achievement  or  attitudes  suggesting  that  simpler  art  in 
TEC  lessons  would  be  equally  effective  and  acceptable. 

Markham  (1979)  replicated  Borg  and  Schuller’s  experiment  using 
the  same  TEC  lesson  but  with  even  simpler,  hand-drawn  artwork. 

He  used  both  reserve  soldiers  and  college  students.  His  results 
confirmed  the  finding  that  no  performance  differences  could  be 
found  between  the  simple  and  complex  artwork. 

One  problem  with  this  general  conclusion  is  that  the  criterion 
measures  in  the  experiments  have  almost  always  been  paper  and 
pencil  or  visual  identification  rather  than  actual  performance' 
tests.  It  may  be  that  realistic  presentations  do  not  improve 
performance  on  paper  but  might  with  actual  equipment.  For 
example.  Wager  (1980)  provided  cardiopulmonary  resusi t at  ion  (CPE' 
training  in  the  form  of  text,  films  or  actual  demonstrations 


and  then  rated  the  students  on  their  ability  to  perform  CPR .  Ti 
film  and  live  demonstration  group  performed  better  than  the  text 
group  although  none  of  the  groups  were  able  to  perform  CPR 
satisfactorily  as  a  result  of  their  presentations. 

Experiment  1  herein  dealt  with  this  issue  and  found  no  important 
differences  in  performing  a  cable  assembly  task,  between  line 
drawings  and  colored  pictures  presented  via  videodisc.  It  also 
found  a  speed  (but  not  accuracy)  advantage  to  training  and  test  1 
using  the  same  type  of  presentation  for  training  as  for  testing. 
The  data  thus  indicates  that  line  drawings  vs.  colored  pictures 
is  not  a  critical  factor,  ever,  in  a  perf ormance  task. 

There  are  a  number  of  conditions  which  enhance  the  effect  of 
high  realism  in  visuals.  First,  realistic  visuals  are  more 
effective  in  self-paced  instruction  when  the  learner  has  control 
over  the  rate  of  presentation  (Dwyer,  1975).  Second,  the 
effectiveness  of  a  highly  realistic  visual  depends  in  part  on  th 
number  of  relevant  cues  accessible  to  the  learner  within  the 
visual  (  Dwyer,  1980).  Third,  color  helps  to  augment  the  effect 
of  realism  (Dwyer,  1980,  1967,  1968,  1969).  Fourth  and  possibly 
most  important,  sufficient  time  to  adequately  process  the 
realism  must  be  alloted  (Dwyer,  1978:  Dwyer.  1980). 

The  foregoing  suggests  that  highly  realistic  displays,  such  as 
photographs,  modelsor  real  objects,  can  confront  a  learner 
with  too  much  stimulation  too  quickly.  If  the  learner  is  not 
given  enough  time  to  process  the  information  or  is  not 
initially  directed  to  relevant  aspects  of  the  complex  graphic 
the  graphic  could  reduce  learning.  There  is  also  a  motivational 
aspect  of  high  realism  which  mitigates  the  learner's  difficulty 
in  processing  these  graphics.  For  example,  young  children 
initially  prefer  simple  line  drawings,  but  after  the  5th  grade 
they  begin  to  prefer  more  complex  visuals  and  photographs  b\  a 
ratioof  857c  to  15rc.  Younger  children  do  like  illustrations  of 
the  familiar,  but  as  they  grow  older  they  like  complex  visuals 
of  the  unfamiliar  more.  Adults  lack  interest  in  photographs 
which  are  of  new  or  unfamiliar  material,  especially  when  they  ar 
ambigious  (Spaulding.  1955).  Students  prefer  to  look  at  more 
complex  visuals  (Myatt  and  Carter,  1979).  They  also  will  attend 
complex  visuals  for  longer  periods  of  time. 

Thus,  the  motivation  related  to  visual  realism  will  hcl;  a 
learner  to  "stay  with"  the  visual,  but  the  visual  can  overwhelm 
the  learner  if  it  is  improperly  utilized. 

Pi  ct  ures 

Research  has  also  shown  that  pictures  can  improve  instruct  to::  r 
elementary  reading  (Peeck.  197*4),  high  school  mathematics 
(Rase  o,  Tennyson,  and  Bout  well.  1975),  high  school  and  coll  err* 
biology  (Dwyer.  1967.  195S)  and  military  fire  fighting 
(Sellman.  1972).  A  recent  review  of  twelve  research  stur.ie- 
by  Levine  and  Lespol  d  (  1978)  has  shown  that  pt  ct  ur*  s  car. 
facilitate  prose  learning. 


Line  Drawings 


Several  researchers  recommend  that  highly  realistic  visual 
presentations  be  edited  of  all  irrelevant  cues  and  the  redundancy 
of  the  relevant  cues  increased  to  ensure  better  learning.  They 
make  a  case  for  extensive  use  of  the  line  drawing,  a  visual 
which  contains  only  the  essence  of  the  realistic  situation 
(Levie  and  Dickie,  1973;  Black,  1962;  Travers,  1967;  Dwyer,  1978) 
Line  drawings  have  proven  to  be  an  effective  means  of  visual 
instruction  a  number  of  times,  especially  in  presentations 
which  are  externally  paced  (Attneave ,  1954;  Dwyer,  19G7,  1968. 
1969,  1971,  1976;  Moore  and  Sasse.  1971;  Rusted  and  Coltheart. 
1979;  Borg  and  Schuller,  1979;  Carpenter,  1954;  Lumsdaine  and 
Gladstone,  1958;  May,  1965). 

One  important  effect  of  the  line  drawing  is  to  reduce  the 
difference  between  students  of  different  reading  levels  (Park- 
hurst,  1976).  Line  drawings  appear  to  be  very  useful  for 
initial  learning  of  concepts  ( Ryer  and  Schwartz,  1965).  It 
has  also  been  found  that  children  can  reproduce  a  drawing  by 
portraying  a  skeleton  of  it,  but  cannot  reproduce  details 
(Travers  and  Alvardo,  1970). 

Visuals  in  Externallv  Paced  vs.  Internally  Paced  Instruction 


Research  summarized  by  Dwyer  (1978)  has  shown  that  different 
visuals  are  effective  for  alternative  methods  of  presenting 
visualized  instruction.  In  externally  paced  instruction  (e.g.. 
lectures,  films,  slide-tape,  movies)  where  the  learner  has  little 
control  over  the  pace  of  instruction,  the-  simplified  line 
drawings  in  black  and  white  and  color  were  most  effective  for  the 
visual  identification  and  drawing  tests.  No  differences  between 
the  visual  and  no  visual  conditions  were  found  for  the  terminology 
and  comprehension  tests.  Color  also  enhanced  the  line  drawings 
for  both  simple  and  detailed  line  drawings.  Realistic  photographs 
were  the  least  effective  visuals  for  externally  paced  instruction. 
See  Table  3-1 . 


Table  3-1 

EFFECTIVE  VISUALS  FOR  EXTERNALLY  PACED  INSTRUCTION 

Most  Effective  Visuals 


Task 

Terminology 
I dent i f i cat i on 
Draw:  ng 
Corr.prehens :  or. 
Total  criterion 


S 1  i  de  T apr 

No  visuals 

Simple  line  drawing 

Simple  line  drawing 

No  visuals 

Simple  line  drawing 


TV 

No  visuals 
No  visuals 
Simple  line  draw: 
No  visual s 
N  o  v  i  s  u  a  1  s 


In  internally  paced  instruction  (e.g.  .  programmed  instruction 
where  the  learner  has  considerable  personal  control  ov-.r  tit- 
pace  of  instruction),  black  and  white  and  colored  phot  ograph- 
were  the  most  effective  type  of  visuals.  See  Tablt  3-1 
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Table  3-2 

EFFECTIVE  VISUALS  FOR  INTERNALLY  PACED  INSTRUCTION 


Task 

Terminology 
I  dent i f icat i on 
Drawing 
Comprehension 
Total  criterion 


Most  Effective  Visuals 
Text  without  visuals 
Realistic  photographs 
Realistic  photographs 
Text  without  visuals 
Realistic  photographs 


In  studies  comparing  visuals  in  externally  paced  vs.  internally 
paced  instruction  (Dwyer,  1973a, b),  the  results  show  that 
photographs  and  three  dimensional  models  were  most  effective 
for  internally  paced  instruction,  while  simple  and  detailed 
line  drawings  were  most  effective  for  externally  paced  instruction. 
A  second  study  also  showed  that  photographs,  detailed  line 
drawings  and' three  dimensional  models  were  most  effective  for 
internally  paced  instruction  while  simplified  line  draw-ings  were 
most  effective  for  externally  paced  instruction. 

In  summary ,  simplified  visuals  are  more  effective  if  the 
instructional  pace  is  externally  (teacher)  controlled.  Realistic- 
photographs  and  models  were  more  effective  if  the  instruction  is 
internally  (student)  controlled.  Color  can  effectively  enhance 
visuals  for  both  externally  and  internally  paced  instruction. 
Visuals  were  also  more  effective  for  achievement  tests  requiring 
a  visually  related  response. 

Visual  Preferences 


Research  has  shown  that  both  children  and  adults  prefer  instruction 
with  color  and  visuals  over  black  and  white  and  non-visual 
instruction  (Dwyer.  1978;  Chute,  1979;  Johnson  and  Roberson,  1979: 
Lamberski ,  1980;  Gulliford,  1973;  Merrill  and  Bunderson .  1979. 

Myatt  and  Carter,  1979;  Simonson,  Thies,  Burch,  1979). 


SECTION  II.  COLOR 

II. 1  Color  Guidelines 


•  There  is  substantial  evidence  which  attests  to  the  fact  that 
the  .iudicious  use  of  color  in  visuals  is  a  viable  i r.st  ruct  i  ona  1 
variable  in  improving  student  achievement  of  specific  education;: 
objectives.  (Dwyer,  I960) 

•  Varied  methods  of  cubing  visualized  instruction  car.  be  used 

to  heighten  student  interest  and  enthusiasm:  however,  con.- 1  ant 
repetition  of  a  single  type  of  cueing  technique  may  quickly 
produce  disinterest  and  boredom .  (Dwyer.  1980) 


•  The  inappropriate  use  of  visual  materials  or  gimmicks  in 
the  t each i ng- learn i n g  process  may  actually  distract  learner 
attention  from  essential  learning  cues  and  depress  subsequent 
achievement.  (Dwyer,  1980) 

•  All  attention  gaining  cueing  strategies  are  not  equally 
effective  in  increasing  student  achievement.  (Dwyer,  1980) 

•  (Visual  and  color)  cues  can  be  effectively  employed  to 
facilitate  student  achievement  of  specific  educational 
objectives.  (Dwyer,  1980) 

,  In  general,  color  has  little  demons! rat ed  effect  on  performance 
but  may  enhance  learning  when  used  to  emphasize  relevant 
cues  and  when  actual  color  discrimination  is  required. 

(Merrill  and  Bunderson,  1979) 

•  Color  is  an  effective  instructional  cueing  device. (Moore 
and  Nawrocki ,  1978) 

,  The  addition  of  color  does  not  intrinsically  increase 

achievement-  However,  color  can  enhance  achievement  of  specific 
instructional  objectives.  (Moore  and  Nawrocki,  1978) 

•  Color  materials  are  generally  preferred  to  black  and  white. 
(Moore  and  Nawrocki.  1978) 

,  Color  is  beneficial  for  tasks  which  require  a  color-based 
response.  (  Mocre  and  Nawrocki.  1978) 

,  Research  has  found  that  people  prefer  to  receive  and  interact 
with  presentations  that  occur  in  color.  (Dwyer,  1978) 

,  Color  interests  children,  but  there  is  no  evidence  that  it 
helps  them  learn.  For  older  persons,  the  studies  report 
an  apparent  lack  of  color  affecting  learning.  However,  there 
is  evidence  that  it  reduces  the  rate  of  forgetting  on  long 
term  retention  tests.  Adults  consistently  prefer  color. 
(Gulliford,  1973) 

,  Changes  in  brightness,  intensity  or  color  are  important  for 
sustained  at  tent  i  or.,  sens  i  t  i  vi  t  y  and  normal  functioning. 
(Gulliford,  1973) 


1 1. 2  SUPPORTING  RESEARCH  ON  COLO?. 

The  literature  seems  fairly  conclusive  on  the  fact  that 
color  does  not  always  improve  learning,  although  it  may 
result  in  slightly  better  retention  (Allen,  1971:  Chute,  1979- 
and  almost  always  is  preferred  over  black  and  white  present  at  i  c  r..-  . 
However,  it  appears  that  there  is  a  difference  between  th*  us* 
of  color  ir  motion  presentations  such  as  film,  or  TV  and  static 


presentations  such  as  slides  or  print.  The  use  of  color  in 
motion  presentations  (where  it  is  often  confounded  with  realism) 
does  not  result  in  significant  performance  gains.  For  example, 
Kanner  and  Rosenstein  (1960)  and  Rosenstein  and  Kanner  (1961) 
conducted  two  extensive  studies  with  videotape  using  soldiers 
as  subjects.  They  compared  color  versus  black  and  white  lessons 
along  with  verbal  cueing  and  found  no  advantage  for  the  color. 

They  concluded  that  labeled  cues  in  black  and  white  were  as 
effective  as  color  cueing. 

For  static  presentations,  color  may  have  some  advantages  over 
black  and  white.  For  example  in  Dwyer's  studies,  colored 
versions  of  line  drawings  were  consistently  more  effective  in 
facilitating  student  achievement  across  all  criterion  measure.-. 
Berry  (1977)  found  that  while  both  realistic  and  nonrealistic 
color  cueing  in  si i des  resulted  in  significantly  more  recognition 
than  black  and  white  on  an  immediate  test,  only  the  non¬ 
realistic  color  cueing  resulted  in  significantly  better  recognition 
on  a  delayed  test.  This  result  suggests  that  color  may  not 
improve  immediate  learning  but  may  affect  retention. 


A  significant  learner  variable  which  has  consistently  been 
identified  in  this  line  of  research  is  the  interaction  of 
aptitudes  with  color.  Generally  color  is  more  effective  with 
high  aptitude  learners  (Allen.  1975).  For  example,  Chute  (1980) 
showed  color  and  black  and  white  versions  of  a  film  to  students 
with  high  and  low  spatial  aptitude.  On  both  immediate  and 
delayed  tests,  the  low  spatial  aptitude  students  scored  better 
with  the  black  and  white  version.  The  difference  was  greatest 
for  the  delayed  test.  This  clearly  has  implications  to  Army 
training.  Moore.  Nawrocki  and  Simutis  (1979)  have  suggested 
that  the  effectiveness  of  graphics  may  vary  with  an  individual's 
spatial  aptitude.  See  also  Kozlowski  and  Bryant,  (1977). 

There  are  two  pragmatic  considerations  which  mitigate  the 
research  results  on  color.  The  first  is  that  the  predominant 
mode  of  media  today  is  color.  Whether  it  makes  any  measurable 
difference  in  performance  or  not,  students  are  used  to,  and 
expect  color  presentations.  Color  appears  to  have  strong  affective 
appeal  as  indicated  by  the  fact  that  most  people  prefer  to  watch, 
color  presentations. 

The-  second  pragmatic  consideration  is  the  wide  range  of  color 
quality  found  in  television  receivers  in  actual  use.  either 
a  property  of  the  equipment  or  poor  tuning  by  the  user.  It  seer- 
somewhat  ridiculous  to  carry  out  research  on  the  precise  qualitie- 
of  color  for  TV  viewing  when  the  actual  quality  of  the  color 
will  vary  so  greatly  in  delivery.  This  consideration  applie.- 
much  less  to  slides  or  film,  where  the  delivery  quality  is  much 
more  uniform.. 


Color  and  .Affect 


The  preponderance  of  evidence  shows  that  colored  materials 
are  preferred  over  non-colored  materials  (Malter,  1948;  Vander- 
Meer,  1952,  1954;  Kanner  and  Rosentein,  1960;  Link,  1961; 
Rosenstein  and  Kanner,  1961;  Miller  and  Booth,  1974;  May  and 
Lumsdaine,  1958;  English,  1961;  Scwietzer,  1963;  Travers, 
McCormick,  and  YanMondf rans ,  1964;  Jones,  1965;  Chu  and  Schramm, 
1967;  Dwyer,  1972;  Lamberski ,  1972;  Katzman  and  Nvehuis,  1972; 
Scarpino,  1972;  Puig,  1976;  Chute.  1978;  Gibson.  1974: 

Johnson  and  Roberson,  1979;  Chute,  1S79;  Kinn  and 
Everett,  1978;  Zuckerman ,  1954).  In  addition,  two  comprehensive 
reviews  of  color  research  cite  a  number  of  studies  which 
support  the  claim  that  colored  materials  are  favored  by  learners 
over  non-colored  materials  (MacLennan  and  Reid,  1967;  Bretz, 
1970).  It  has  been  shown  that  young  children  specifically 
display  a  preference  for  interaction  with  visual  materials  t  t 
contain  color  (MacLean,  1930;  Long,  1945;  Rudisill,  1952; 

French,  1952;  Katzman  and  Nyenhuis ,  1972).  The  preference  ; 
color  among  learners  extends  from  its  use  as  a  coding  device 
to  its  decorative  use.  The  research  confirms  a  common  sensf 
notion  that  colored  materials  are  more  interesting  and  wide 
preferred . 

Color  has  a  definite  physiological  effect  on  perceptual 
mechanisms  and  can  be  attributed  as  the  cause  of  various 
emotional  reactions  (Goldstein,  1942;  Cheskin ,  1948;  Kouwer ,  1949 
Rudisill,  1952;  Collier.  1957;  Gerard.  1958;  Smith,  1958;  Birren, 
1959;  Schwartz,  1960;  Rusenheim,  1967;  Child,  1968;  Nourse 
and  Welch,  1971;  Plank  and  Schick,  1974:  Bornstein ,  1975;  Chute, 
1978:  Adkinson  and  Berg,  1976;  Bornstein,  Lessen  and  Veiskopf, 
1976).  Color  is  more  emotionally  engaging  for  a  learner  (Winn 
and  Everett,  1978;  Ditcher).  Scanlon  (1967)  reports  that  color 
"alters  the  importance  of  the  spoken  word."  He  also  observed 
that  color  helps  viewers  become  more  involved  in  the  instruction 
and  less  passive. 

The  significance  of  preference  is  established  only  if  it  can 
be  shown  that  the  preference  leads  to  increased  attention  or 
motivation  which  in  turn  leads  to  increased  achievement.  A 
number  of  studies  have  shown  that  color  preference  is 
related  to  an  increase  in  learner  motivation  and  sometimes 
increases  in  achievement  (Ingersoll,  1970;  Farr,  1971:  Kalin. 

1972;  Lilly  and  Kellener.  1973;  Daniel  and  Tacker,  1974:  Burke 
Marketing  Research.  1960;  Kumata,  1960;  Gallup  and  Robinson, 

1965;  Schaps  and  Guest,  1968:  Schwerin,  1957;  May  and  Lumsdaine. 
1958;  Birren,  1963:  Dooley  and  Harkins,  1970:  Dwyer,  1972. 

1976a:  Schramm,  1972). 

However,  it  must  be  noted  that  there  are  some  studies  which 
contradict  the  claim  that  preference  is  correlated  with  attention 
and  achievement,  many  researchers  having  expressed  reservations- 
about  the  relationship  of  preference  to  achievement  ( Yar.de rV.ce r  . 
1954;  Dwyer,  1972.  197Gb:  Travers,  1970:  Twyford,  1951  ).  These 
researchers  do  not  deny  that  color  might  have  an  effect  or. 


achievement  but  they  do  point  out  that  there  is  no  necessary 
relationship  between  the  two.  Lamberski  (19S0)  notes  that 
studies  relating  color  and  achievement  in  general  which  result 
in  color  being  ineffective  may  be  using  color  inappropriately, 
namely  as  peripheral  or  of  low  associative  value.  He  summarizes 
this  claim  saying,  "color-code  is  a  sufficient  attention-getting 
strategy  producing  measurable  effects  on  cognitive  learning  which 
cannot  be  accounted  for  by  purely  words  or  labels"  (p.  108), 

The  research  conclusively  shows  that  color  is  the  preferred 
state  of  the  instructional  medium  by  learners.  The  attractiver.es 
variability,  ar.d  complexity  of  color  in  visual  materials  serve  as 
an  interest  gaining  device  which  leads  to  attentive  behavior 
which  in  turn  is  more  likely  to  result  in  increased  performance. 
Color-coding  serves  to  simplify  and  categorize  information  for 
the  learner  and  thus  enableshim  to  focus  his  attention  on  the¬ 
re  levant  . 

Literature  reviews  on  color  often  illuminate  contradictory 
findings  and  that  leads  to  a  stalemate  of  beliefs  about  the 
impact  of  color  on  learning  and  performance.  There  are  several 
reasons  for  the  inconclusiveness  of  the  findings.  First,  the 
use  of  the  variable  has  not  been  properly  executed  in  experiments 
related  to  achievement  (Lumsdaine,  1963:  Lamberski).  This  car. 
explain  why  many  studies  using  color  in  instructional  materials 
have  failed  to  show  any  significant  di f ference . and  unless  the 
color  directly  relates  to  the  inst ruct ion . addi ng  color  does  not 
lead  to  increased  achievement  (Dooley  and  Harkins,  1970; 

MacLean  .  1930'  Gibson,  1952:  YanderMeer ,  1952,  1.54:  Levie  and 
Dickie,  1973:  Johnson  and  Roberson,  1979:  Zuckerman .  1954;  May 
and  Lumsdaine.  1958:  Kanner  and  Rosenstein,  1960:  Kanner,  1961: 
Katzman  and  Nyenhuis  ,  1972:  Kanner,  1968:  Travers,  1967:  Reich 
and  Meisner,  1976).  Many  of  the  reviews  of  the  late  1960's 
were  skeptical  about  the  benefits  of  using  color  in  instructional 
materials  (Kanner,  1968:  Lumsdaine.  1963)  and  possibly  the  reason 
for  that  skepticism  was  related  to  inappropriate  experimental 
questions  ana  research  designs. 

Recall 


Color-coding  has  shown  positive  effects  on  immediate  and  delayed 
recall  (YanderMeer,  1952,  1954;  Lamberski,  ''972,  1975;  Kauffman 
and  Dwyer.  1974;  Scull.  1974:  Hob an  .  1975:  Farley  and  Grant  . 

1976;  Berry.  1977:  Lamberski.  1980).  Successful  recall  is 
dependent  on  a  number  of  other  variables  including  age.  time 
of  interaction,  and  attentiveness  (Dwyer,  1972a:  Frechtling. 

1970)  but  the  use  of  color  as  a  coding  device  seems  to  have  a 
great  impact  on  recall  in  visual  and  spatial  tasks  (Otto  and 
Askov,  1968:  Dwyer.  1972a:  Reich  and  Meisner.  1973;  Shaw.  1975;. 

There  is  a  substantial  body  of  research  that  shows  that  color 
enhances  recall  on  paired  associates  tasks  (Committee  on 
Coiometry.  1954:  Weis-  and  Marg'  lis,  1954:  Peterson  and  Peterson  . 
1957;  Underwood,  Han  and  Ekstrand.  1962:  Berry.  1969:  Goodman. 


1975;  Bu'hanan,  1975;  Isaacs,  1966;  Suede  and  McNulty,  1967; 
Otto  and  Askov ,  1968;  Corballis  and  Luthe,  1971;  Arnold  and 
Bower,  B  wer ,  1972;  Newby  and  Young  ,  1972;  Light,  Berger, 
Bardales.  1975;  Petrich  and  Chiesi ,  1976;  Winn,  1976,  1977; 
Green  and  Anderson,  1956;  Bourne  and  Restle,  1959;  Salz,  1963). 

Schontz,  Trunin,  Willians  (1971)  showed  that  color  helps 
retrieval  under  the  following  conditions: 

(a)  there  are  many  categories  of  information, 

(b)  the  number  of  concepts  per  category  is  small, 

(c)  the  colors  used  are  highly  discr iminable . 

Using  color  under  such  conditions  will  lead  to  better  recall. 
Perceptual  Tasks 


Color  facilitates  performance  in  a  number  of  perceptual  tasks 
such  as  counting,  searching,  discrimination,  locating,  and 
recognizing.  A  very  clear-cut  finding  is  that  if  a  target  object 
has  a  unique  and  pre-desi gnated  color  coding  known  by  the 
individual,  then  color  definitely  aids  in  the  identification  of 
that  object.  For  target  identification  involving  photographs, 
color  showed  a  29"  advantage  over  black  and  white  (Markoff,  1972). 
In  identification  tasks  color  is  a  superior  code  to  coding  by 
size,  by  brightness,  and  by  shape.  Color  is  not  superior  to 
alphanumeric  coding,  however  (Christ,  1975).  When  a  subject 
is  using  a  display  where  targets  are  chromatically  characterized , 
adding  color  to  the  display  interferes  with  the  subject's  ability 
to  identify  the  proper  target.  This  interference  occurs 
whether  the  color  is  central  to  the  target  or  not.  In  a 
search  task,  color  is  the  best  advice  for  codings  over  size, 
brightness,  shape,  and  alphanumeric.  In  fact,  color  ranges 
from  a  40"  to  63"t  savings  in  search  time  over  these  other  types 
of  codes.  The  results  hold  for  both  older  and  younger  individuals 
(Lamberski,  1980). 

Higher  Order  Cognitive  Tasks 


There  is  proportionately  less  research  done  in  the  area  of 
color  affecting  higher  cognitive  tasks.  Color-coding  during 
concept  acquisition  may  enhance  subsequent  learning (  Lamberski, 
1980).  Subjects  having  color-coded  instructional  materials  did 
better  on  tests  for  comprehension  and  terminology  than  those 
havinc  black  and  white  (Lamberski,  1980).  Other  studies 
show  that  color  coding  used  in  active  self-paced  materials 
(books,  posters,  etc.)  has  no  effect  on  concept - 1 earni ng  (Travers 
et  al . ,  1964;  Rusted  and  Coltheart  .  1979;  Scarpino,  1970; 

Dooley  and  Harkins,  1970;  Scull.  1974;. 
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Learning  rates  and  performance  were  better  in  learning  phonic 
materials  and  beginning  reading  when  color  coded  materials 
were  available  in  the  form  of  underlining,  shading,  etc. 
(Gattegno,  1962:  Crui  ckshanck ,  1967;  Jones,  1968;  Bannatync- . 

1966  ;  Knafle,  1974;  Lyczak,  1976;  Hinds  and  Dodds,  1968). 

Color  facilities  in  dramatic  portra;  .1  (Reich  and  Meisner,  1973) 
Color  also  helps  in  tasks  which  require  the  perception  of 
movement  (Travers,  1969). 

Color  Coding 


Research  shows  that  color  ^an  be  u-eci  as  an  effective  instruct  io 
coding  device.  Color  coding  is  often  as  effective  or  more 
effective  than  other  coding  devices.  The  superiority  of  color 
coding  over  number,  shape  and  alphanumeric  coding  is  well 
established  for  locat i on-search  and/or  counting  tasks  (Christner 
and  Ray.  1961;  Hitt.  1961:  Jones,  1962;  Christ  and  Corso,  1975; 
Christ,  1974,  1975;  Barker  and  Krebs,  1977;  Brooks,  1965;  Dyer 
and  Christman,  1965;  Green,  Mitchell  and  Jenkins,  1953:  Heglir. , 
1973;  Smith,  1962;  Shontz,  Truman,  and  Williams,  1971;  Green  and 
Anderson,  1956).  Color  coding  also  reduces  reaction  times  and 
errors  for  whatever  task  is  being  performed  (Semple,  Heapy  and 
Conway,  1971;  Jones,  1962;  Reed,  1951;  Burnette,  1970;  Christ 
and  Teichner,  1973;  Smith,  1973;  Kopala,  1979;  Wolfe  and  Zigler, 
1959;  Reed,  1951). 

Christ  (1974.  1975)  reviewed  43  studies  on  the  use  of  color 
code  vs.  achromatic  codes  and  came  to  the  conclusion  that  color 
coding  is  definitely  superior  to  other  codes  under  some 
conditions,  but  can  be  detrimental  under  others.  It  is  not  wise 
to  suppose  that  color  coding  is  universally  effective.  At  tir.es 
color  coding  may  serve  as  "noise"  when  it  is  irrelevant  or 
overly  dominating.  Color  is  particularly  harmful  on  some 
identification  tasks  (Aliusi  and  Muller,  1958:  Barker  and 
Krebs,  1977;  Hitt,  1961).  On  some  other  tasks  color  had  little 
effect  (Levie  and  Dickie,  1973;  Kanner,  1968:  Travers,  1967) 
and  in  other  (e.g.,  comparing,  verifying)  no  type  of  code  was 
helpful  (Barker  and  Krebs.  1977).  However,  the  importance  of 
color  coding  in  organizing  information  (especially  with  dense 
displays),  helping  discrimination,  and  facilitating  locating  arc 
all  significant  advantages. 

The  potency  of  color  varies  with  the  display  density.  For 
very  dense  displays  color  does  not  have  a  facilitating  effect 
and  at  the  same  time  for  very  sparse  displays  color  offers  no 
advantage.  Thus,  the  usefulness  of  color  does  vary  with  the 
density  of  the  display,  its  optimum  effect  lying  somewhere  be- twee 
very  dense  and  very  sparse  displays  (Christ.  1975).  Smith  (lt‘63 
showed  that  as  display  density  increased  from  20  to  100  item- . 
using  a  color  code-  reduced  search  time*  over  black  and  white  cod-' 
by  450  to  70“  .  Similarly,  on  a  counting  task  for  the-  same  rang- 
of  density,  color  coding  reduced  thr-  time-  on  the  task  by  63 
to  697.  The  effectiveness  of  color  coding  as  a  function  of 


display  density  would  seem  to  show  a  curvilinear  effect  for 
its  superiority  over  achromatic  coding. 

When  the  display  is  simple  and  uncluttered  any  particular 
code  will  make  little  difference  in  performance.  However,  as 
the  display  becomes  complex  and  dense,  color  has  an  over¬ 
whelming  advantage  over  any  other  code  (Christ  and  Corse,  1975; 
Linton,  1975;  Wolf  and  Zig'ler,  1959;  Green,  McGill  and  Jenkins, 
1973;  Heglin,  1973;  Shontz,  Trunin  and  Williams,  1971).  Color 
coding  works  better  when  the  number  of  objects  per  category/ 
code  is  reasonably  small  (Shontz,  Trurnm  and  Williams,  1971; 

Smith  and  Thomas,  1964).  It  has  also  been  shown  that  color 
codes  are  more  facilitative  when  the  target  code  is  well  known 
in  advance  r  Green  and  Anderson,  1956;  Smith.  1962:  Brooks ,  1965: 
Barker  and  Krebs,  1977).  When  the  subject  already  has  a 
strategy  for  dealing  with  a  code  already  in  use, adding  color 
causes  interference  with  the  strategy  and  can  harm  performance 
(Kanarick  and  Peterson,  1971).  Color  coding  can  be  superior 
even  to  subscripts  or  underlining  in  comparison  and  counting 
tasks  (Smith.  Farquhr,  and  Thomas,  1965).  Practice  with  a 
particular  color  code  is  very  effective  (Christ  and  Corso ,  1975). 

Processing  Time 


One  significant  finding  is  that  color-coded  instructional 
materials  require  a  greater  amount  of  time  to  process  and  work 
through  than  do  parallel  black/white  materials  (Lamberski,  19SU). 
Psychologically,  color  requires  more  time  to  perceive  (perhaps  up 
to  4  times  as  long),  process,  and  store  (Dwyer,  1972;  Berry, 

1974;  Lamberski,  1980;  Gulliford,  1978).  When  instructional 
efficiency  is  defined  as  achievement  gain  per  instructional  time, 
color  and  black/white  materials  produce  similar  efficiency  values 
(Lamberski  and  Meyers.  1980).  Other  studies  confirm  that 
because  of  this  increased  demand  for  processing. unless  this 
demand  is  met  color  may  be  detrimental  or  insignificant  on 
learning  (Hock  and  Egath ,  1970;  Dwyer,  1972;  Young,  1973;  Berry. 
1974;  Galbraith,  Homann  ,  and  Cruetzi'ield ,  1975). 

Using  Specific.  Colors 

An  important  question  arises  about  which  colors  are  the 
most  adequate  for  use  in  coding.  Color  imagery  is  more  quickly 
recognized  that,  black/white;  this  difference  is  magnified  as 
resolution  decreases  (Markoff,  1972).  Several  studies  have  exam: 
which  colors  are  most  quickly  identified.  In  Table  3-3  the  color 
are  listed  in  terms  of  increasing  response  speed  from  top  tc 
bottom. 
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Table  3-3 

ORDERED  RESPONSE  TIMES  TO  DIFFERENT  COLORS ,  FROM 
LEAST  (TOP)  TO  GREATEST  TIME  (BOTTOM) 


a  *-• 

a 

■ 

< 

r* 


LEE  (1969) 


MEISTER  AND  KREBS,  WOLF  AND  BLOOMF I  ED 

T'LLI VAN  (1969)  SANDVIG  (  1978)  (1979) 


Red 

Red 

Red 

Red 

Blue 

White 

Yel 1 ow 

Blue 

Yel low 

Yel low 

Magenta 

Green 

Green 

Green 

Whi  te 

T  an 

Black 

Blue 

Blue 

Wh  i  t  e 

W  h  i  t  e 

Green 

HILGENDORF  (1971) 

SMITH  (1963) 

Amber 

Violet 

Red 


Wh  1 1  e 

Orange 

Red 

Green 

Blue 


a 


>• 


Reynolds,  White  and  Hilgendorf  (1972)  identified  the  following 
colors  as  being  associated  with  fewest  identification  errors: 
GREEN.  RED.  WHITE.  YELLOW. 

Cook  /  1974)  recommends  using  the  following  colors  in  a  display: 
PURPLE.  GREEN.  BLUE,  YELLOW,  ORANGE.  RED.  This  conclusion' is’ 
based  on  his  review  of  the  literature.  Caution  must  be  taken  ir. 
using  the  color  blue  especially  for  smaller  symbols,  lines, 
alphanumeri cs .  Wald  (1967)  reports  that  the  fovea  of  the  human 
eye  (that  which  serves  to  perceive  details),  is  essentially  "blue- 
blind."  Blue  is  best  used  for  large  blocks  of  color  coding 
rather  for  alphanumerics  and  small  detailed  symbols. 

Contra  ct 


Some  of  the  background  variables  are  important  considerations. 
In  general,  the  greater  tne  contrast  between  the  background 
and  the  foreground  colors  the  fewer  the  errors  that  occur  in 
identification  (Barnes.  1970).  The  optimum  symbol -background 
luminance  ratio  is  10:1  (Barker  and  Krebs.  1977).  As  contras: 
value  increases,  the  reading  time  of  a  color  code  decreases 
substantially  (Mclean  .  1965).  Barnes  (  1970)  reported  that  a 
black  background  resulted  in  the  best  performance  while  a  white 
background  resulted  in  the  worst  performance.  He  also  found 
that  white  .  yellow,  or  orange  colors  on  a  black  background 
resulted  in  optimum  performance  when  compared  with  other  color 
cor:  i  r, at  i  or,.-  . 


Height  of  Symbols 


The  symbol  height  of  colored  coded  symbols  is  important  in 
display  design.  The  use  of  small  colored  symbols  results  in 
the  symbols  appearing  achromatic  or  in  alternate  symbols  of 
similar  color  being  confused  (Bishop  and  Crook,  1961;  Mavesing, 
1976).  Smith  (1962)  constructed  a  table  (Table  3-4)  of 
recommended  symbol  heights  for  symbols  to  be  color-coded 
according  to  the  type  of  information  being  presented: 

Table  3-4 

RECOMMENDED  MINIMUM  ALPHANUMERIC 


HEIGHT  FOR  COLORED  SYMBOLS 


Type  of  Info 

critical  data, 
variable  position 

critical  dat a . 
fixed  position 

non-critical  data 


High  Luminance 
. 007-. Oil 

. 005- . Oil 

.003- .011 


Lo  Luminance 


.011-. 017 


.008-. 017 


.003-. 011 


Ambient  Illumination 


For  many  displays  the  major  factor  contributing  to  effectiveness 
is  the  ambient  illumination.  Additional  ambient  light  decreases 
the  symbol  to  background  contrast  and  colors  will  tend  to  saturate 
or  fade.  Any  luminance  below  3  cd/n2  will  result  in  users  being 
unable  to  discriminate  colors.  A  luminance  of  30-300  cd/m2  will 
allow  for  compatable  perception  of  the  display.  A  high  luminance 
(3000  cd/m2)  also  makes  it  hard  to  see  colors.  Under  conditions 
of  high  luminance,  red  becomes  the  superior  color  for  coding 
(Barker  and  Krebs,  1977).  When  a  fast  response  is  needed  under 
these  conditions  it  is  recommended  that  only  3-4  colors  be 
utilized  per  display  (Semple  et  al.,  1971). 

The  color  of  the  ambient  lighting  can  have  a  drastic  impact 
on  the  color  code  perceived  on  the  display.  Semple  et  al .  (1971) 
provided  a  table  (3-5)  listing  some  of  the  ambient  lighting  effects 
on  display  colors : 


Table  3-5 


AMBIENT  LIGHTING  EFFECTS  ON  DISPLAY  COLORS 


Target 

Color 

Red  Light 

Blue  Light 

Green  Light 

Yell  ov. 

Light 

White 

Light  Pink 

Light  Blue 

Light  Green 

Light  Yellow 

Black 

Red  Black 

Blue  Black 

*  Grenn i sh  Black 

Orange  Black 

Red 

Brilliant 

Dark  Bluish 

Yellowish  Red 

Bright  Red 

L.  Blue 

Red 

1  Red 

Greenish  Blue 

L i  g h t  P. e ddis h 

D.  Blue 

Red  Blue 

Bright  Blue 

Dark  Green 

Blue 

Green 

Dark  Purple 

Brilliant 

Blue 

Light  Reddish 

Yel low 

Olive  Green 

Blue 

Brilliant 

Pur pi e 

Brown 

Red  Orange 

Green  Blue 

Green 

Yellow  Greer. 

Brown  Red 

Light  Red 

Green  Yellow 

B  r  i  I  1  i  a  n  t  Li  g 

Brown 

Dark  Olive 

Orange 

Bluish  Brown 

Brown 

Brownish  Oran 

Semrie  et  al  .  .  1971. 


When  the  luminance  contract  is  low.  the  display  is  dense,  or 
resolution  is  poor,  the  size  of  the  symbols  being  colored  must  be 
increased  proportionately  (Barker  and  Krebs,  1977).  Color 
requires  an  increased  symbol  size  of  5 OR  over  black  and  white 
symbols  to  be  effective.  A  reasonable  standard  is  15  TV  scar,  lines 
symbol  (as  a  minimum) .  A  black  and  white  system  needs  only  10 
lines/ symbol  for  100~  accuracy  in  character  recognition  (Ericksen. 
1957:  Shurtleff,  1966). 

There  can  potentially  be  problems  with  color  comparison.  Table 
3-6  illustrates  a  study  which  examined  errors  in  identification 
of  different  colors. 

Table  3-6 

ERRORS  IN  IDENTIFICATION  CALLED 


SHOWN 

RED 

ORANGE 

YELLOW 

GREEN 

TOTAL 

'JiCL  L.iCC 

FICATIO 

RED 

V 
- * 

21 

0 

0 

21 

2 . 9 

ORANGE 

9 

y 

10 

0 

19 

2.6 

YELLOW 

0 

6 

X 

15 

21 

2  9 

Green 

0 

0 

6 

X 

6 

.  8 

67 

2 . 3 

Connolly.  Spanier,  and  Champion.  1975' 

When  the  display  constitutes  a  peripheral  field,  then  blu-  an 
yellow  panel  lights  on  a  gray  background  with  a  low  amount  o; 


ambient  light  produce  the  best  results.  A  white  background 
for  the  peripheral  field  caused  more  errors.  When  the  ambient 
light  was  reduced  then  colors  were  recognized  from  further 
away  (Dudek  and  Colton,  1970). 

Number  of  Colors  to  Use 

The  number  of  colors  to  use  in  color-coding  display  is  a 
critical  consideration.  Under  ideal  conditions  and  with  much 
practice  a  person  can  identify  up  to  50  colors  (Hanes  and 
Rhoades,  1959).  However,  good  accuracy  of  i  dent  i  f  i  cat  i  on  car, 
be  obtained  under  ordinary  circumstances  with  10  colors  (Barker 
and  Krebs,  1977;  Con  over,  1959).  Shontz,  Trumrr.  and  Williams 
(1971)  recommend  that  a  maximum  of  23  colors  can  be-  used  for 
color-coding  in  search  tasks.  It  must  be  remembered  that  as 
the  number  of  colors  used  as  codes  increases,  so  do  errors . 

Table  3-7  shows  how  errors  increase  with  number  of  colors; 

Table  3-7 

INCREASING  COLORS  AND  RESULTING  ERRORS 

No.  of  colors  errors  ( T  ) 

1G  2.5 

12  4.5 

15  5.2 

17  2  S . 6 

Four  colors  (RED.  ORANGE.  YELLOW,  and  GREEN)  can  be  identified 
with  97-99T  accuracy  (Connelly,  Spanier,  and  Champion.  1974). 

On  the  other  hand,  as  the  number  of  colors  used  as  codes  increase 
the  response  time 'search  time  decreases.  The  following  graph, 
Figure  3-1  from  Hitt  (1961)  shows  the  relationship: 

Figure  3-1 


Effect  of  number  of  code  levels  on  performance 


Avg . 

responses 

per 

minute 


-i 


Redundant  Color  Coding 

An  important  way  to  use  color  is  to  use  it  redundantly.  Tht.-ro 
are  a  number  of  multiple  redundant  codes  which  work  better  than 
a  single  code.  They  are  listed  below: 

1.  Color-numeric  Anderson  &  Fitts,  1958;  Hitt,  3  Ho 

2.  Color-shape  Sanez  E  Richie,  1974;  Erickson  an 

Hake  .  1 955 

3.  Color  used  redur.-  --Connolly,  Spanier ,  E  Chamricr., 

dantly  with  any  --Smith.  1963 

other  code 

4.  Color-symbol  size 

5.  Color-size-brightness  (Garner  &  Creelm.an,  1964) 

(Erickson ,  1954 ) 

Smith  (1963)  reports  some  impressive  gains  in  performance  with 
redundant  color  code.  Redundant  color  reduced  search  time 
by  65r;  ,  count  time  by  691.  and  errors  by  761. 

Redundancy  in  using  sense  modalities  for  instructional  cueing 
has  received  a  general  endorsement  from  researchers.  Gu:  Ilford 
( 1973  )  sums  it  up : 

"Redundancy  is  probably  the  most  effective  com¬ 
munication  device  man  has  found  to  cope  with  equivocation 
and  error.  However,  it  inevitably  raises  the  cost  of 
information  processing  in  terms  of  time  and  capacity,  as 
redundancy  necessarily  takes  up  information  space  and  or 
time."  ( p .  23 ) 

McCormick  (1970)  adds, 

"While  the  evidence  about  some  aspects  of  human 
behavior  is  a  bit  inconclusive;  there  is  virtually  no 
question  but  that  the  use  of  redundant  visual  and 
auditory  coding  increases  the  odds  of  reception  of 
the  information."  (p.  122) 

Research  does  show  that  using  visual  cues  in  auditory  task.- 
as  well  as  auditory  cues  on  visual-  produce  achievement  most 
effectively  (Buckner  and  McGrath.  1961:  Symons.  1963;  Speith. 
Curtis  and  Webster.  1954.  Mudd  .  1961;  I>av  ar.d  Beach.  1950;  Hula; 

and  Van  Orm.er.  1950a:  Hartman  .  1961a:  Inv.er  (19781  lists  56 


studies  whici 
Fi cks  .  1956 , , 

J  sup 

port  this  claim. 

:  Miller 

.  1956: 

Poll ack 

A  cau- ion  is 

t  h  a  t 

when  audio  and 

print  v 

i  s  u  a  I  m ; 

i  x e rial  i 

pre-sen  ted  t  o 

stun 

e  n  l  s  s  :  m  u  1  t  a  n  e  o  ? 

i  s  1  y  .  i ! 

i  s  t  h  e- 

audio  ch 

or  print  channels  (Mowbray,  1952,  1953,  1954;  Klcrnrv-r  195G, 

1958;  Bulgarella  and  Archer,  1962;  Lockhard  and  Fidowski.  1961; 
Williams  and  Derks .  1963;  Koen ,  1969).  Visual  modes 
are  more  facilitative  for  complex  tasks  (Gulliford,  1973).  A 
third  caution  relates  to  the  amount  of  time  a  learner  is  allowed 
to  interact  with  multiple  coded  materials.  When  using  two 
channels  it  is  imperative  that  the  learner  have  sufficient  time 
to  process  the  dually  coded  information.  If  the  presentation 
rate  violates  these,  the  learner’s  performance  will  degenerate 
Gulliford  ,  1973). 


The  following  are  some  specific  findings  about  the  use  of 
color  as  a  redundant  code: 

1.  When  partially  redundant  color  is  added  to  a  search 
display  and  the  subject  does  not  know  the  color,  the 
search  performance  deteriorates.  The  search  time 
increases  by  236  over  a  monochromatic  display  and  726 
over  a  color  coded  display.  (Christ,  1975) 

2.  Redundant  color  coding  in  symbolic  displays  docs  not 
decrease  search  time  when  the  subject  knows  the 
target  color  before  hand.  (Christ.  1975) 

3.  The  advantage  of  knowing  the  target  color  in  advance 
increases  as  the  density  of  the  symbols  increase  and 
as  the  number  of  non-target  colors  increases. 

( Christ  ,  1975) 

4.  Without  a  redundant  color,  when  the  display  density 
increases  and 'or  the  number  of  non-target  colors 
increase,  search  time  accordingly  increases  substantial! 

5.  Tor  partially  redundant  color-coding  which  the  subject 
knows  in  advance,  the  search  time  decreases,  but  as 
the  number  of  non-targets  bearing  that  same  color 
increases,  searchtime  begins  to  increase  until  the 
number  of  non-targets  exceed  706  of  the  total  number  of 
targets  at  which  point  knowing  the  target  color  is  a 
disadvantage.  (Christ.  1975) 

6.  When  the  subject  knows  the  target  color  beforehand, 
the  decrease  ir,  search  time  and  gain  in  overall 
performance  remains  whether  the  color  is  used  redundar.il 
or  not.  (Christ.  1975;  Sanez  and  Richie.  1974) 

7.  Using  code  redundantly  leads  to  an  increase  :  n  accuracy 
in  the  i  dent  i  f  l  cat  i  on  of  simple  targets  (it  has  a  €-• 
advantage  over  size  code.  1046  over  brightness  cod-  . 

616  over  size  and  brightness  code).  (Christ.  197o 


The  maximum  amount  of  information  transmission  occurred 
for  all  amounts  of  transmitted  information  when  a  color 
code  was  used  redundantly  with  a  numeric  code.  It 
surpassed  the  numeric  alone  as  well  as  the  color  code 
above.  (Anderson  and  Fitts.  1958) 


An  important  point  to  bear  in  mind  in  considering  redundant  coding 
is  the  increase  in  complexity  and  number  of  stimuli  being  presented 
Any  increase  in  display  complexity  and  density  results  in  greater 
errors  and  search  time  (Green  and  Anderson.  1956:  Smith  and  Thomas . 
1964;  Smith.  1963).  Thus,  codes  have  to  compensate  for  these 
efforts  and  facilitate.  Multiple  codes  used  non-rc-dundant  ly  can 
help  increase  the  number  of  symbols  which  can  be  absolutely 
identified  on  a  display  (Barker  and  Krebs,  1971:  Garner  and 
Creelman.  1964:  Ericksen.  1954  ).  It  also  helps  to  increase  t  re¬ 
number  of  identifiable  categories  of  information  (Barker  and  Krebs, 
1977).  Partially  redundant  codes  can  be  used  when  information 
can  be  categorized  at  more  than  one  level  of  specificity.  Totally 
redundant  coding  should  be  used  when  targets  or  stimuli  can 
be  identified  on  several  dimensions.  This  improves  symbol 
detectability,  the  probability  of  being  identified,  and  discrimir.- 
ability  among  symbols. 

SECTION  III  MOT  If-:: 

111.1  GUIDELINES 

•  Complex,  fixed  pace,  motion  graphics  may  be  beneficial  for 
individuals  of  high  mental  ability  but  may  deter  learning  for 
individuals  of  lower  mental  ability.  (Merrill  and  Bunderson,  197 

9  Motion  generally  has  little  effect  on  learning  except  when  the 
information  to  be  learned  deals  directly  with  motion  or  Chang-.  . 
However,  we  hypothesize  that  realistic  dramatic  sequences  may 
have  considerable  value  in  increasing  interest,  motivation, 
emotional  impact,  and  in  changing  attitudes.  (Merrill  and 
Bunderson.  1979) 

1 1  I. 2  SUPPORTING  RESEARCH  ON  MOTION 


The  research  shows  that  motion  generally  has  no  effect  on 
learning  unless  the  task  to  be  learned  uses  motion  (Levic 
Dickie.  1973;  Silverman.  1958:  Allan  and  Weintraub.  1968). 
tasks  involving  motion,  motion  pictures  are  better  than  se> 
still  frames.  Slides  are  evert  better  than  the  sequential  : 
(Wells,  Van  Mi uid f  ran.-.  .  Post  lot  hwa  i  t  .  and  Butler.  1973).  D 
teaching  concepts  involving  time,  movie.-  art  superior  ( Gul 
1  973  ).  When  the  1  earning  task.-  i  nv-ol  v<  factual  recall,  m 
as  well  as  drunat  izat  m. .  m.  - 1 1  .  and  realism  a  •  not  facilit.e 
achievement  (Horan  and  Van  Orm-  r,  195u  Travers  .  19G7. 
Reseating  rr/>\  l  on>  of  mot  or  skill-  :m;rove-  acuui  sit  ion  :  H 


men 


A  problem  with  motion  pictures  is  that  real  time  may  go  so 
rapidly  that  the  learner  is  unable  to  perceive  and  process 
well  (Merrill  and  Bunderson,  1979).  Also,  research  on  motion 
films  has  shown  that  even  when  the  topic  has  inherent  notion 
only  about  45T-  of  the  motion  is  relevant.  For  other  topics 
where  motion  is  not  crucial  it  is  estimated  that  90-95T  of  the 
motion  could  be  eliminated  without  reducing  comprehension 
( Gul 1 i ford ,  1973). 

Allen.  Daehlinp.  Russell,  and  Nielsen  (  1970)  compared  motion 
pictures,  still  frames,  print,  and  audio.  They  showed  that 
motion  is  very  effective,  but  if  they  added  audio  to  the  motion 
the  advantage  of  motion  over  stills  was  eliminated.  Audio 
with  still  pictures  worked  as  well  as  audio  with  notion. 
Similarly,  other  researchers  have  identified  instances  where 
motion  pictures  are  equal  to  still  frames  (Allen,  I960:  Alien. 
Cooney,  and  Weintraub.  1968:  Wells,  et  al  .  ,  1973 

A  study  conducted  by  Wells  et  al..  (1973)  looked  specifically 
at  the  differences  between  presentation  of  concepts  involving 
either  time  or  space  using  still  photographs,  slide/tape,  and 
movies.  Their  results  indicated  that  for  concepts  involving 
time  (i.e..  a  series  of  continuous  events),  movies  were  better 
than  the  static  presentations.  However,  the  opposite  was  true 
for  concepts  involving  space.  This  suggests  that  motion  may 
be  important  for  certain  types  of  procedural  instruction. 

Animated  Three-Dimensional  Graphic s 


Research  has  shown  that  animated  three  dimensional  graphics 
can  aid  in  maintenance  and  performance  tasks  with  real  objects 
(Boeder,  1978:  Brock.  1978:  Crawford,  1977:  Frev  and  Eikert . 
1978)  . 


Merrill  and  Bunderson  ( 1 978 ) suggest  several  areas  where  motion 
instruction  could  be  beneficial.  These  major  areas  are  presented 
in  the  following  sections. 


Performing  Gross  Motor  Skills 


Motor  behavior  occurs  when  a  trainee  is  able  to  execute  a 
physical  movement  with  precision  and  appropriate  timing.  Motor 
skills  are  involved  in  such  Army  tasks  as:  marching,  swimming, 
painting  a  barracks,  typing  a  report,  operating  a  piece  of 
equipment,  using  hand  tools,  adjusting  a  microscope,  etc.  M--t  or 
behavior  often  involves  the  execution  of  a  series  of  several 
coordinated  movements.  The  order  in  which  these  individual 
movements  are  performed  may  be  taught  independently  from  the 
actual  movement .  For  example,  the  order  in  which  the  part-  of 
a  rifle  arc-  assembled  may  bt  taught  independently  from  the 
motor  skills  required  to  put  t he  parts  together.  The  role  of 
graphics  in  teaching  procedures  is  described  in  another  sect::':.. 


It  is  difficult  to  imagine  a  trainee  being  able  to  learn  a 
cornel  ex  motor  skill  solely  from  verbal  or  textual  informal: 


The  move-rent?  must  be  demonstrated  to  the  stud-n:  either  by 
an  instructor  or  through  the  use  of  sortie  pictorial  rcpiv.-'-nt  :.t 
In  some  situations,  a  live  demonstration  may  not  be  ideal  if 
the  model  is  unable  to  perform  the  movement  slowly  enough  for 
the  trainee  to  see  the  critical  aspects  of  the  movement.  Tin- 
serving  of  a  tennis  ball  is  difficult  to  demonstrate  for  this 
reason.  A  series  of  still  pictures  which  show  critical  posit i 
or  aspects  of  the  movement  in  discrete  intervals  across  time- 
may  be  more  instructive.  Frazier  (1976)  refers  to  this  as  ps>- 
anirr.at  ion  .  If  care  is  not  used  with  pseude-ar.  i  m.a :  i  on  .  the 
critical  continuity  of  the  movement  may  be  lost.  A  motion  pic 
has  some  of  the  same  advantages  and  disadvantages  of  a  live 
demonstration.  If  the  movement  is  shown  in  real  time,  it  may 
be  too  fast.  However,  slow  motion  would  demonstrate  the 
continuity  of  the  movement  *'hi  le  slowing  it  down  sc-  to  at  th* 
critical  aspects  could  be  perceived.  Re  pet  i  t  ions  of  the  dema.r. 
t ion  or  motion  pictures  can  improve  the  learning  of  motor  ski  1 
(  Hobar.  and  Van  Orman,  1950).  Learning  may  also  be  facilitated 
if  the  trainee  can  stop  the  motion  picture  film  and  practice  t 
motor  skill  rather  than  trying  to  practice  the  skill  while  the 
film  is  in  progress.  Even  mental  practice,  where  the  learner 
thinks  through  the  various  motions  may  be  effective  (Travers, 
1967,  Bandura,  1977).  The  videodisc  may  make  a  significant 
contribution  in  this  learning  area  as  it  has  better  capabiliti 
for  slow  motion  and  freeze  frame  than  videotape  and  film. 

Practice  is  crucial  in  the  learning  of  a  motor  skill.  However 
practice  is  only  beneficial  if  the  learner  receives  some  feedl 
This  feedback  may  be  intrinsic  to  the  task  (as  when  the  correct 
letter  is  typed  on  a  piece  of  paper),  or  may  require  the  jiu ago: 
of  an  instructor.  Many  complex  motor  skills  are  difficult  to 
learn  because  trainees  cannot  totally  observe  their  own  res p or 
and  thus  are  unable  to  compare  their  responses  with  the  com  c 
form  '.Bandura.  1977). 

This  problem:  can  be  alleviated  by  videotaping  the  trainee's 
performance  and  using  the  videotape  lor  feedback. 

Steering  ar.d  Guiding-Continuous  Movement 

-  . '  _  '  .  i 

Steering  and  guiding  behavior  involves  a  percept ual -mot  or  ski  I 
where  the  trainee  must  cont i nuously  scan  or  monitor  certain 
external  cues  and  execute  appropriate  movements  on  a  cont  i  r.uiu 
basis  in  accordance  with  the  perceived  cues .  Such  ski  I  led 
behavior  is  required  in.  driving  a  tank  down  a  mad.  land:;. a  an 
aircraft,  tracking  an  air-to-air  gunnery  target  .  etc  . 

Steering  and  guiding  behavior  involves  a  combination  of  thv 
skills  where  relevant  cues  are  embedded  in  a  high  nois-. 
environment.  Cues  then  serve  as  signals  for  the  execution 
of  the  a  r ;  r  o  p  nat  e  mo  tor  ski  1  1 . 


*  • 


In  the  early  stapes  of  training,  the  detecting  of  relevant 
cues  should  be  taught  independently  of  the  motor  skills,  using 
graphics  as  described  by  Merrill  and  Bunderson  (197  6  )  .  T  h  t-  i.v )  i  o  r 
skills  could  be  taught  as  described  in  the  section  or.  "Motor 
Skills.”  The  intermediate  stages  of  training  should  integrate 
the  detecting  of  cues  with  the  corresponding  motor  skills.  The 
integration  of  these  skills  could  take  place  in  a  training 
simulator  such  as  the  Link  Trainer. 

In  the  final  training  stages,  the  learner  should  be  given 
opportunities  to  practice  and  demons-,  rat  e  proficiency  in  a 
realistic  setting.  Practice  and  corrective  feedback  are 
absolut  ely  e.-sv  r.t  i  a  I  . 

Corn  lex  Procedur-.  - 


Many  procedures  are  so  complex  and  or  the  consequences  of 
error  are  so  great  that  it  is  impractical  to  require  trainees 
to  memorize  the  sequence  of  steps.  In  such  cases,  a  job  aid 
which  lists  the  steps  or  presents  a  flow  chart  of  the  steps 
should  be  used. 

If  the  procedure  involves  extensive  motor  skills,  the  stc-rs 
of  the  procedure  and  the  motor  skills  could  be  taught  simul¬ 
taneously  by  live  demonstration,  motion  pictures,  (with  slow 
motion  if  real  time  is  too  fast),  or  with  a  series  of  still 
pictures  (see  section  on  Motor  Skills).  If  film  or  pictures  are 
used  to  demonstrate  the  steps  of  the  procedure .  the  performance 
should  be  photographed  so  that  the  representation  shown  has  the 
same  view  or  angle  that  the  trainee  would  see  if  he  were  doing 
the  procedure  himself  (Hoban  and  Van  Ormer.  1950).  The  videodisc 
allows  for  a  combination  of  slow  motion  and  still  graphics  that 
was  difficult,  if  not  impossible,  with  previous  technology. 

If  the  procedure  involves  the  assembly  of  a  piece  of  equipment 
with  many  parts,  and  the  motor  skills  required  already  exist 
in  the  repertoire  of  the  learner,  graphics  would  not  be 
necessary  to  show  the  actual  motor  skills  required.  However, 
graphics  would  be  necessary  to  show  the  various  parts  of  the 
equipment  and  their  relationship  to  each  other.  The  graphics 
would  need  to  be  supplemented  with  verbal  or  textual  instruct i 
which  list  the  order  in  which  the  various  parts  should  be  as  semi  ltd. 

Whenever  feasible,  t he  trainee  should  be  given  opportunities  to 
practice  performing  the  procedure  using  equipment.  In  any  cas-.  . 
hands  on  performance  test i nc  shculd  be  included  to  insure  learning 
transfer  has  occurred. 

This  concludes  the  Merrill  and  Bunderson  summary,  1976. 

C  a  r  t  c  o  r.  s 


Cartoons  have  been  the-  subject  of  some  experimental  scrutiny. 
Ka^fmar.  ar.d  Dwyer  (1974)  shewed  that  cartoons  were  preferred 
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over  photographs  and  that  they  were  more  effective  on  both 
immediate  and  delayed  recall.  Other  studio:-  have  shown  that 
instructional  cartoons  are  no  more  effective  than  other 
presentation  techniques,  but  may  promote  a  more  favorable 
affective  response  (Baker  and  Pop-ham,  1965:  Popham,  1969; 
Freisinger,  1976;  Lumsdaine  and  Gladstone,  1958).  One  study 
reported  that  cartoons  require  a  significantly  shorter  time 
to  perceive  and  process  than  line  drawings,  photographs,  and 
shaded  drawings  (Ryan  and  Schwartz.  1956). 

In  a  recent  study.  Sewell  and  Moore  (1980)  help  to  clarify 
these  ambagious  findings.  They  conclude  that  if  the  dominant 
concern  is  for  students  to  enjoy  the  topic  then  cartoons  are 
the  most  effective  type  of  visual.  However,  if  the  objective 
is  comprehension  then  cartoons  are  not  worth  the  cost  needed 
to  develop  because  printed  text  is  equally  effective  and 
cheaper  to  produce. 

Animation 

It  is  difficult  to  find  research  that  examines  the  instructions 
effect  of  animation.  It  seems  to  be  primarily  prized  for  its 
entertainment  value  and  only  secondarily  for  its  instructional 
potential.  In  recent  instructional  development  efforts, 
especially  since  the  advent  of  CAI  ,  animation  has  begun  to  be 
taken  more  seriously  as  an  instructional  medium.  Current 
advances  in  computer  technology  are  starting  to  pave  the  way  io 
innovative  ways  of  using  graphics  in  instruction  never  before 
available.  Two  notable  innovations  that  will  be  discussed 
here  are  computer-generated  imagery  and  animation. 

Because  this  development  is  so  new  little  experimentation 
has  been  done  to  compare  its  relative  effectiveness.  Some 
dramatic  anecdotal  evidence  recently  reported  in  an  editorial 
(Lodding  and  Nickson.  1980)  might  foreshadow  the  future  of 
computer-generated  animation.  A  group  of  researchers  concerned 
with  the  workings  of  an  internal  combustion  engine  developed 
an  animated  simulation.  During  the  initial  previewing  of 
the  film  the  researchers  noted  an  unanticipated  erratic  phenome 
It  turned  out  that  this  was  an  acoustical  oscillation  of  fuel 
within  the  cylinder  which  had  been  happening  all  along  but  had 
never  been  noticed.  Earlier  numerical  simulations  had  hidden 
this  because  of  the  phenomenon's  relative  obscurity  amid  other 
dominating  happenings.  This  discovery  turned  out  to  be  very 
significant  because  the  phenomenon  had  direct  bearing  on  the 
engine's  fuel  efficiency.  The  important  point  is  that  such  a 
critical  phenomenon  was  totally  concealed  until  brought  to 
light  through  sophisticated  computer  capabi lilies. 

The  salient  concern  of  researchers  is  how  to  improve-  the 
technique  and  duality  of  this  com  rut  er-pe  nerat  ed  art.  Inst  c-au 
of  worrying  at  this  point  about  human  performance  effects,  it 
j -  worth  not l ng  th<  ext  ent  to  which  computers  are  being  ut i 1 1 ze 
in  the  production  of  various  kinds  <  '  visual  aids.  Tn>. 
following  is  a  sampling  of  tie  variety  of  wav.-  they  arc  use:: 


1.  An  irr.a  t  i  or  - -ca  rt  oons  ,  special  effect  movies,  TV 
commercials  (Borrell,  1980). 

2.  S imul at i on-- f 1 i ght -t rai ni ng  (Borrell,  1980). 

3.  Computer-generated  imagery--logos ,  3D  figures,  slide 
designs  (Nouri,  1980;  Lewell,  1980). 

4.  Computer-aided  desi gn--archi tect ure ,  printed- 
integrated  circuitry  (Borrell,  1980). 

5.  Computer-assisted  cart ography --geograph i cal  informat: 
system  (Borrell,  19S0). 

6.  Information  systems  graphi cs — home  information  system 
management  information  systems  (Borrell,  1980). 

7.  Computer-assisted  instruction. 

8.  Medicine  (Borrell.  19S0). 

It  is  evident  that  computer  assistance  in  the  production  of 
graphics  has  already  pervaded  many  disciplines.  It  is  just 
becoming  a  widely  used  device  for  visual  communication. 

There  are  two  methods  utilized  in  this  computer-assist ed 
graphics.  The  most  prevelant  is  the  digital  method.  The  arti 
inputs  a  drawing  directly  into  the  computer  by  way  of  a 
digitizing  tablet.  The  entire  picture  is  broken  up  into  minu: 
points,  termed  pixels.  The  artist  has  direct  control  over 
each,  pixel  and.  then,  can  manipulate  the  original  drawing  ir. 
many  ways.  The  artist  can  store,  change  color,  adjust  positir 
modify  size,  or  add  depth  to  the  image  or  any  part  of  it 
(Lewell.  1980).  The  artist  has  a  wide  range  or  power  to 
manipulate  the  image  as  he  sees  fit.  He  can  tear  it  apart 
and  recombine  bits  and  pieces  to  make  an  entirelv  new  image 
(Trost  .  1980). 

All  of  these  artistic  manipulations  are  quite  simple.  The 
artist  can  choose  any  of  256  colors  and  by  merely  touching  if 
with  a  stylus  he  can  experiment  with  different  colorings.  He 
can  experiment  with  hue.  saturation,  brightness  and  grey 
scale'  SMPTE ,  I960;.  In  addition,  the  computer  can  generate 
certain  geometric  shapes  (e.g.,  circles,  squares)  for  use  in 
his  art.  He  can  also  store  specialized  shapes  and  characters 
for  later  use  '  55  METE  .  1980,. 

The  significance  of  the  digital  method  is  the  tremendous 
control  and  flexibility  t he  artist  ha- .  For  the  average  cole  r 
TV  monitor,  he  has  direct  control  over  250.000  pixels  in  a 
number  of  cu  if  erent  way*-.  Tie.  re-alt  ing  creation  can  be-  out  pu 
to  either  video  or  film  (Nouri  .  3  980  >  .  Trie  artist  has  never 
beer  so  f roe  to  exoo r iiTiOnt  with  ins  work. 


The  second  method  is  the  analog  computer  system.  A  black  and 
white  drawing  is  transmitted  to  the  computer  by  way  of  a  video 
camera.  Once  in  the  computer  the  picture  can  be  manipulated. 

With  this  method  the  video  signal  is  under  the  control  of  the 
analog  computer  and  an  artist  can  create  flips,  bends,  and 
oscillations  to  make  a  very  sophisticated  image  (.Nouri,  1980). 
There  is  not  the  extensive  control  over  the  image  in  the  analog 
as  with  a  digital.  Moreover,  the  analog  method  is  much  quicker 
(Trost  .  19S0).  Eventually  the  artist  who  wants  ultimate  control 
will  have  to  digitize  the  original  image. 

The  CAESAR  (Computer  Animated  Episodes  using  Single  Axis 
Rotation)  system  combines  both  the  analog  ar.d  digital.  The 
initial  input  picture  is  brokc-n  down  into  segments  of  the 
picture  such  as  a  leg  or  arm.  The  control  isn't  over  individual 
pixels  but  over  these  larger  components .  These  con.pon- r.t  >  car. 
be  rotated  or  changed  as  desired.  Other  components  can  be 
added  to  the  scene  to  create  the  desired  effect.  Animat  ion  i  s 
produced  by  drawing  the  final  frame  of  a  sequence  and  then 
directing  the  computer  to  produce  all  the  in-between  sections 
from  the  initial  to  the  final  by  averaging  out  the  changes 
across  the  number  of  frames. 

There  have  been  several  criticisms  made  of  computer-gonc-ratc-d 
imagery  and  animation.  First,  because  the  computer  averages 
out  motion  across  frames  there  is  a  loss  of  the  "imagi  nat  ior." 
and  "sympathetic  naturalization"  that  an  art : s*  lends  to  hi s 
work  (Nouri  ,  I960).  Second,  there  is  generally  a  poor  or 
inadequate  resolution  of  figures,  although  this  state  of 
affairs  is  improving  rapidly  (Nouri.  1980).  Third,  the  speed 
of  digital  computer  production  is  rather  slow.  It  takes  time: 
to  produce  art  this  way  (Lindner,  1980,’.  Fourth,  real  time 
animation  remains  problematic.  There  are  250.000  to  1 . 000 . 000 
pixels  required  for  each  frame  and  at  30  frames  per  second 
achieving  real  time  animation  is  a  very  difficult  task 
(Lindner.  1980).  Fifth,  although  the  prohibitive  costs  of  the 
past  have  been  substantially  reduced,  the  cost  of  computer 
prod.  c...  on  remains  high  (Lindner,  1980).  These  are  genuine 
limitations  which  prohibit  more  expansive  use  of  computers  in 
design.  However,  efforts  are  being  made  to  overcome  them  and 
many  of  these  will  be  solved  in  the  very  near  future. 

The  advantages  of  using  computers  to  generate  graphics  haw 
beer,  extensively  identified  in  the  literature.  First,  tediou- 
aspects  of  artistic  creation  (e.g.  .  opaquing  and  inking)  art- 
done  by  tne  computer  (Nouri.  1980).  Second,  the  editing 
powers  by  way  of  the  computer  control  are  enormous  .  The  capaM'iit 
of  changing,  at  will,  colors  ,  hues,  speed,  motions,  and  positior.in 
allows  the  artist  to  see  and  tinker  with  a  picture-  immedi  at  el  \  . 
Editing  takes  only  a  few  second.'  and  no  redrawing  or  reshoot :  r.r 
is  required  (Nouri  .  1980:  Barrel  1  .  1980;  Li  ndr.er  ,  1 9  SO :  Asamu.’uy. 
and  Futai,  1980:  Tiost,  1980).  Third,  the  motion  of  computer 
animation  is  more  fluid  (Lindner.  1989.  Trost  .  1980).  Tin- 


can  be-  due  to  the  increased  frame  rate  of  the  computer 
animation  (30  per  second)  over  film  (24  per  second).  Fourth, 
computers  a  ail  the  artist  of  more  colors  than  film  (Lindner, 
1980).  Fifth,  color  shift  does  not  occur  nor  do  oil  layers 
(Lindner,  1980).  Sixth,  there  is  no  deterioration  of  color 
or  picture  over  time  and  usage  (Asamizuya  and  Futai ,  1980). 
Seventh,  output  of  drawings  can  be  rapid  (Borrell,  1980). 
Eighth,  the  storage  of  the  work  is  far  more  convenient 
( Borrel 1 ,  1980). 

The  future  of  computer  graphics  looks  very  bright.  Writings 
are  replete  with  predictions.  Perhaps  the  most  significant 
forecast  is  that  soon  corr.put  er-generatea  animation  and  imagery 
will  exhibit  a  greater  realism  than  even  film  is  capable  of 
(Lindner.  1980:  Noun.  19S0:  Prince,  1980:  Brown  and  Levins.  198 
Tne  price  of  graphics  systems  as  well  as  memory  will  decline 
(Brown  and  Levine,  19S0:  Lindner,  19S0).  At  the  same  time 
there  will  be  better  graphics  software  which  will  enable  even 
more  control  over  editing  the  image  (Lindner,  1980).  There  wil 
be  better  resolution,  better  video  displays,  better  input 
devices,  hardware  that  will  enable  excellent  reproduction  of 
computer  generated  images  and  more  available  memory  (Brown  and 
Levine  ,  1 980  )  . 

The  artistic  capabilities  will  be  multiplied.  Brown  and  Levine 
(19801  make  a  very  interesting  prediction: 

"True  three-dimensional  displays  will  become  common . 
Researchers  will  finally  be  able  to  see  their  models 
in  three  dimensions  without  'he  need  of  special 
glasses,  stereo  pairs,  or  by  viewing  the  two-dimensional 
project  ions . " 

They  optimistically  predict  that  computers  will  revolutionize 
the  art  world  in  the  same  wav  that  acrylics  did. 


SECTION  IV. 


SOUND  AND  VOICE  INPUT  AND  OUTPUT 
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Research  on  Use  of  Sound 


Sound  is  an  important  determinant  of  the  effectiveness  of 
instructional  materials.  As  reported  earlier,  redundant  sound 
with  visuals  increases  comprehension  (McCormick,  1970;  Buckner 
and  McGrath,  1961;  Synrons,  1963;  Speith,  Curtis  and  Webster, 

1954;  Mudd,  1961;  Day  and  Beach,  1950;  Huban  and  Van  Ormer,  1950a; 
Hartman,  1961a;  Miller,  1956;  Pollack  and  Eicks,  1956).  Dv.-yer 
(1978)  lists  56  studies  which  support  this  claim.  In  an 
extended  series  of  studies  at  Johns  Hopkins,  Chapanis  (1973,  1975, 
1976a,  1976b)  and  his  colleagues  (Chapar.is,  Ochsrr.an ,  Parrish  and 
Weeks,  1972,  1977;  Chapanis  and  Overbey ,  1974)  have  investigated 
two  person  problem  solving  dialogues  intended  to  simulate  rr.a:.- 
computer  interactions  of  the  future.  They  have  consist  ent 1 y 
found  that  oral  communication  (voice  and  natural  communication' 
results  in  much  faster  problem  solving  than  typing  or  handwriting. 
As  might  be  expected,  the  number  of  words  and  messages  is  far 
greater  with  voice  than  with  written  communication.  They  also 
found,  however,  that  natural  human  communication  is  characterized 
by  many  small  errors,  which  would  quickly  contuse  current  computer 
systems . 


Experiment  5  of  the  research  conducted  for  the  Presentation 
Features  protect  found  a  similar  result.  Subjects  using  voice 
input  would  mumble  to  themselves,  give  tentative  answers,  and  ir. 
other  ways  violate  the  very  structural  input  rules  normally 
associated  with  a  keyboard.  It  is  clear  from  both  Chapar.is’  work 
and  our  own  that  while  voice  input  and  output  is  potentially 
a  very  efficient  means  of  communication,  the  computer  will  have 
to  develop  a  framework  of  expectations  so  that  it  knows  what  it 
is  looking  for  in  the  conversation.  Humans  appear  to  do  this 
all  the  time.  Moreover,  human  conversation  is  particularly 
forgiving  of  errors  in  syntax  and  even  in  thoughts.  Again,  this 
is  probably  because  each  partner  has  an  understanding  of  the 
subject  matter  and  a  set  of  expectations  for  what  is  likely  to 
come  next.  In  computer  science  these  matters  are  commonly 
referred  to  as  "natural  language  understanding."  Significant 
progress  has  been  made  in  this  area  in  the  last  decade-  (cf.. 

Brown,  Rubinstein,  and  Burton,  1976),  but  much  remains  to  be 
accomplished  before  a  fielded  system  is  available  for  general 
purpose  interactions.  In  the  meantime,  voice  and  other  sound 
output  will  be  used  far  more  than  voice  input,  which  will  primari.;. 
be  used  where  hands  or  eyes  are  busy,  or  the  user  is  away  from 
terminal.  Chapter  6  presents  voice  input  systems  in  more  detail. 

Sou n d  Present  at  ion? 

Realistic  voice  or  other  sounds  are  require  d  for  many  kind'  o: 
modeling,  where  the  object  i  ve  is  to  chance  attitudes  or  n 
illustrate  a  procedure  tv.  :  resent  i  r.c  an  ex  pi  r »  .  Moreover  ,  esau.:- 
are  required  to  man*'  certain  discriminations  <  e  .  c.  ,  between  a 


» 


motor  running  smoothly  or  roughly)  These  uses  are  especially 
important  for  simulations  where  the  student  needs  realistic 
presentations  in  order  to  gain  hands  on  experience. 

V<e  hypothesize  from  observation  that  non-voice  sounds  (e.g.,  those 
in  penny  arcade  games)  can  add  excitement  and  motivation  to 
simulations,  and  that  such  simulations  and  games  may  increase  the 
number  of  hours  of  practice  that  students  will  put  in.  This 
observation  has  been  repeated  with  many  different  content  areas 
and  ages  of  students. 

Presentations  Using  Sound 

Sound  is  widely  used  for  training  and  simulation  applications. 
These  include  voice  output,  music,  and  tones  (e.g.,  as  used  ir. 
electronic  games).  Analog  systems,  for  example  as  found  in  the 
videodisc,  permit  all  three  of  these  types  to  be  recorded  and 
presented.  Digital  recording  is  also  available,  and,  if 
sufficiently  high  quality,  can  present  both  music  and  voice.  An 
alternative  to  digital  recording  is  to  synthesize  either  tones  or 
a  voice  using  hardware.  In  general,  analog  recordings  have  the 
highest  fidelity,  digital  recording  comes  next  in  quality,  and 
synthesized  sound  has  the  lowest  quality.  However,  digital 
recording  can  be  arbitrarily  good,  and  can  easily  exceed  the 
capabilities  of  even  the  best  analog  recordings.  On  the  other 
hand,  the  storage  requirements  for  very  high  fidelity  digital 
recordings  are  severe.  One  application  of  high  fidelity  digital 
recording  is  to  present  symphonies  on  a  small  optical  videodisc 
which  has  a  very  large  memory  capacity. 

As  described  above,  voice  quality  varies  widely  depending  upon 
the  type  of  system,  used.  Not  surprisingly,  the  quality  required 
determines  to  a  large  extent  the  price  for  a  system. 

Recorded  Sound.  A  number  of  means  are  available  to  record  voice. 
One  of  the  most  simple  is  pulse-code  modulation  ( PCM ) .  This  is 
a  simple  digitization  of  the  voice  input.  It  is  very  flexible, 
easy  to  use,  offers  arbitrarily  good  fidelity,  and  uses  a  great 
deal  of  memory.  Another  approach  to  voice  recording  is  delta 
modulation.  This  approach  offers  many  of  the  same  advantages  as 
pulse  code  modulation,  but  also  includes  the  disadvantages  of 
high  storage  requirement. 

A  quite  different  approach  is  to  model  the  human  vocal  tract 
and  to  store  only  the  data  from  the  incoming  voice  sicnal  which 
is  required  to  drive  the  vocal  tract  model  to  reproduce  approxi¬ 
mately  the  same  sound  as  was  input  into  the  system.  Whereas  PC)! 
and  Delta  modulation  permit  both  voice  and  music  to  be  recorded, 
LPC  is  limited  to  voice,  since  it  uses  a  model  of  the  vocal  tract. 
LPC  uses  far  less  storage  for  equivalent  quality  than  either  PC)' 
or  Delta  modulation.  Thus  the  delivery  side  of  LPC  can  be  ver\ 
inexpensive.  For  this  reason  LPC  is  the  method  used  by  Texas 
Instruments  in  th"ir  talking  games.  The  drawback  is  that  encoding 
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the  voice  input  is  quite  complex  and  expensive .  Who  re  this 
cost  can  be  amortized  over  thousands  of  delivery  systems,  the 
problem  is  less  severe  than  in  a  development  shop  which  is 
constantly  trying  new  sounds. 

Synthesized  Sound.  An  alternative  to  recorded  voice  is  to 
synthesize  the  voice  output  from,  speech  sounds  like  phonemes  and 
allophones  (parts  of  word  sounds).  This  approach  is  by  far 
the  least  expensive  and  most  flexible  for  change  (since  new 
words  can  be  created  by  simply  typing  in  the  string  of  speech 
sounds).  On  the  other  hand,  this  approach  produces  robot  -1 
sound  which  is  far  below  the  quality  of  recorded  voice  at  pr-.-a*.-  r. 

SEC T I  ON  V.  IN TEE ACTION  PROCESSES 

Tv res  of  Interactive  Dialogues 


Ar.  excellent  resource  for  interactions  and  other  basic  features 
of  man /machine  design  is  Human  Factors  In  Computer  Sy  st  err.s :  _  A 
Review  of  the  Literature  by  H.  Rudy  Ramsey  ejt  _al_  (1979).  Table 
3-7  presents  their  typology  of  interactive  dialogues. 

The  bulk  of  electronic  delivery  system  interactions  for  instruct 
consist  of  a  simple  prompt  or  question  and  a  student  response . 
Tnese  interactions  are  reminiscent  of  a  programmed  text  or  work¬ 
book  approach.  The  nature  of  interactions  can  be  significantly 
changed  if  an  electronic  delivery  system  is  used  for  simulations 
ar.d  activities  which  require  the  student  not  only  to  learn  about 
the  content  but  rather  to  actually  engage  it  and  take  part  in  it 
An  example  is  a  two  dimensional  (TV  screen)  simulation  in  which 
a  student  must  troubleshoot  ar.  electronic  circuit.  Here  the  stu 
initiates  the  bulk  of  the  interactions  and  uses  the  electronic 
delivery  system  as  a  tool  or  a  resource  lor  gathering  in format ic 
about  the  system. 


Components  of  Interaction 


This  level  of  interactions  requiring  preformatted  displays, 
responses  to  the  display,  and  branching  to  other  preformatted 
display.-  does  not  require  much  processing  intelligence  or.  th< 
part  of  the  delivery  system..  Machine  (or  artificial)  intel  I  a  per. 
pormit.-  more  sophist  l  gated  levels  of  interaction.  An  intel  lie-. 
s  vst  t  r.  ol  int  •ru  ct  ior."  consist  s  of  four  elements: 

(1  ■  Ar.  :  r.  *.  *  race  iv>  mod*  1  o_f th-  content  being  taught.  A:. 

exam:  1  ».•  is  t  f.c  :  iece  ol  equipment  being  simulated  ir. 
a  m.:  irtenanv*.  t  roub  I  es  hoot  i  n  g  task  or  the  set  of  ruit  .*• 
of  an  turn-  wh:  r.  ar-  used  by  a  student  who  is 

p r a c t  1  c  :  i.  g  -  r a.  t 

<  2  A  r '  d-  1  of  an  •  \ ;  -  rt  w:.  op*rat<  the  syst  t  m. .  A:. 

examz.-i*  of  is  a  t  roui-i  esr.oot  mg  procedure  or  an 

alg  rithm  i  c.r  d-.  mg  long  division.  The  expert  fur..:: 
can  u<  v<  re  s:m:  1*  or  vert  complex.  A  sim.pl-.-  fur.,  t  2  n 
is  a  list  of  si-  :  >  in  a  pros*  durt  .  A  mm*.  com; 
exp*,  rt  would  {•••  a  i  h--ss  playing  program. 


DUtoqu*  Type  DMtrlptton  (wnlt  Prl»*cl|Ml  UpffrrncM 
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(3)  A  mode 1  of  each  student.  The  model  can  be  very  s i ::q  1  , 

for  example  the  number  of  right  and  wronc  response.-  on 
a  series  of  mathematics  problems.  Or  the  model  can  Ik 
quite  rich,  and  include  an  estimation  of  the  student's 
skill  in  each  of  30  areas  required  to  fly  a  jet  plane. 

The  major  point  to  be  made  about  the  student  model  is 
that  it  is  not  simply  a  record  of  the  student’s  key 
presses  or  other  interactions  with  the  system.  In  order 
to  model  the  student  in  any  useful  way,  the  student  '  s 
interactions  must  be  related  to  the  content.  An  exam;:!- 
is  a  drill  and  practice  program  in  reading  which  aids 
the  student  to  master  letter-sound  correspondences.  Th-. 
student's  successes  on  each  spelling  pattern  car.  be 
recorded  independently.  Ir.  this  way  the  interact  ions 
are  related  to  the  content  structure. 

(  4  >  An  _adv  isor  to  make  comment  s  or  seq  u  en  c  e  act  ivit  ies  _t  h t 

w_i_H  move  the  st  udent  performance  c  loser  to  that  o  f _ t  h_e 

expert .  In  essence,  the  advisor  must  compare  the 
student's  performance  to  expert  performance,  then  deter¬ 
mine  which  skill  area  will  be  worked  on  next  and  what 
method  will  be  used  to  decrease  the  difference  between 
the  student's  performance  and  that  of  the  expert.  The 
advisor  function  may  be  handed  over  to  the  student  who 
must  then  decide  what  to  study  next.  This  may  have 
the  advantage  of  providing  a  "learning  to  learn" 
phenomenon  whereby  the  student  improves  in  the  skill  of 
select  ins:  what  to  study  next  and  how  to  study  it.  On 
the  other  hand,  it  can  readily  be  shown  in  paired  associa 
tasks  that  a  powerful  learning  model  can  estimate  the 
student's  state  of  knowledge  better  than  the  student  can. 
In  this  case,  a  computer  advisor  may  be  able  to  optimize 
the  learning  process. 

Ir,  a  classroom.,  the  subject  matter  is  the  content  model.  The  text 
or  technical  manual  holds  the  expert  model.  Ths  instructor  serves 
both  an  expert  and  advisor  role,  while  the  grade  book  contains 
the  student  model.  The  video  materials  and  computer  program  of 
an  electronic  delivery  system  can  serve  all  of  these  functions. 

V.'f.at  the-  electronic  delivery  system  adds  is  the  capability  to 
rev.  1  icat  e  the  wotk  of  an  excellent  instructor  and  set  of  course 
rr.a  •  (-n  a  1  s  . 

Without  the  capability  o:  replicating  exo  1  lent  interact  ions , 
the  effect  of  a  gO"-d  instructor  is  quickly  lost  whe  n  the  instructor 
leaves.  We  are  all  familiar  with  remarkably  innovative,  pro da. - 
tive,  and  exciting  i  r.  t '  rac  t  :  ons  and  pro  crams  which  revolve  :u\ 
a  small  group  of  t-  q-le  and  art  quickly  lost  who  r;  the  grout 
disbands.  Th-  eii t  rf-nif  (i«.  1 1 very  syst*  r  is  a  means  of  in  i:._ 
personal  wi  t  n  ev<  student.  Ur;  1  i  k<  a  via-  ot.:;o  presentation, 
th-  el  e-  :  r  a  :  c~d-  1~:  v-  r\  system  can  and  should  replicate  th- 
interact  ior.s  of  an  1  1  «-r.t  m -tractor  with  a  stucienv. 


Int er a ct ion  Modes 

The  four  aspects  of  fully  intelligent  interactions  may  be 
operating  simultaneously  and  invisibly  while  the  visible 
interactions  occur.  Visible  interactions  on  electronic 
delivery  system  may  be  classified  in  three  modes:  presentations, 
exercises,  and  generative  interactions. 

In  presentation  mode  material  is  presented  to  the  student  who  is 
essentially  a  passive  recipient.  Non-interact ive  pages  of  text 
or  motion  segments  are  presented  with  accompanying  audio  or 
illustrations  in  any  combination.  The  user  can  control  the  rate 
and  sometimes  the  sequence  of  the  presentation.  In  essence, 
however,  this  mode  is  simply  passive  viewing  or  page  turning.  It 
may  present  an  expert  procedure,  but  does  not  permit  interaction 
with  the  model  of  the  content,  or  with  an  advisor.  It  also  keeps 
no  model  of  the  student. 

The  exercise  mode  permits  users  to  respond  to  stored  questions 
or  problems,  and  to  receive  immediate  feedback.  Branching  depend 
upon  the  responses  of  the  student.  Thus  the  exercise  mode  may 
use  the  expert,  student  model,  and  advisor  functions.  Without 
two  screens  or  without  text  and  graphics  overlay,  most  videodisc 
systems  stop  with  this  mode.  It  should  be  noted  that  some 
simulations  for  fixed  sequence  procedures  use  this  mode  since 
they  are  simply  a  linear  sequence  of  actions  to  be  performed. 

The  student  may  be  prompted  and  then  take  a  particular  action. 
This  corresponds  to  a  standard  multiple  choice  problem  in  which  a 
prompt  or  question  is  posed  and  the  student  is  to  give  one  of 
several  responses. 

The  generative  simulation  mode  introduces  a  model  of  the  system., 
which  permits  new  items  to  be  generated.  The  generation  procedur 
can  be  as  simple  as  producing  new  arithmetic  problems  or  as 
complex  as  modeling  a  navigation  system  for  an  aircraft.  The 
generative  simulation  mode  provides  realistic  exercise  of  concept 
and  rules  while  maintaining  test  integrity,  since  new  items  can 
be  generated  using  the  same  rules  for  test  items  as  for  practice 
items.  This  mode  permits  user  interactions  to  be  more  extensive, 
since  new  exercises  can  be  produced  to  fit  individual  needs.  The 
expert,  student  model,  and  advisor  functions  may  also  be  included 

Experiment  2  of  this  Presentation  Features  study  compared  a  .lob 
aid  type  of  interaction  with  instruction.  We  found  no  signifies r. 
differences  in  total  time  or  accuracy  on  a  performance  task  under 
these  two  interaction  conditions,  so  long  as  total  time  was 
compared  (learning  plus  performance  on  the  one  hand  \s.  performar. 
with  a  .iob  aid  on  the  other',.  Appendix  A  presents  thi> 
exceriment  in  detail. 
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HUMAN  FACTORS  FOR  VISUAL  DISPLAYS 


Visual  displays  have  certain  parameters  or  factors  that  affect 
how  well  an  image  can  be  seen  and,  if  the  image  is  a  written 
message,  how  well  it  can  be  read  and  understood.  In  the  section 
below  we  will  delineate  several  human  factors  that  affect  the 
visibility  and  legibility  of  visual  displays.  Some  of  the 
factors  apply  most  directly  to  CRT  displays  and,  since  CRT's 
are  the  most  common  display  form  for  general  purposes,  emphasis 
will  be  given  to  CRT  applications.  It  should  be  noted,  however, 
that  most  of  the  factors  discussed  below  are  relevant  to  other 
kir.ds  of  displays.  Other  displays  are  discussed  under  Out  put 
Dev i ce  s  . 


V  i  s  i  r  i  1  i  t  v 


Visibility  factors  range  from  classical  display  factors  such 
as  luminance,  contrast,  and  resolution  to  display  problems  such 
as  flicker,  blur,  and  glare.  Each  of  these  factors  will  be 
briefly  defined  and  described.  Recommendations  or  specifications 
made  in  the  literature  will  be  noted.  Table  4 “1  is  a  summary  of 
visibility  parameters  whose  structure  follows  the  outline  of  the 
text.  Vie  have  included  recommendations  from  four  basic  references 
— Shurtleff  (1980).  Bean  (1980).  Cakir.  Hart  &  Stewart  (1980). 
and  Sherr  (1979)--as  part  of  the  table  to  indicate  how  much 
agreement  there  is  between  researchers  regarding  design  specifi¬ 
cations  and  reconm.er.dat  ions  for  the  factors. 

Luminance 


Although  luminance  is  fairly  simple  concept  intuitively,  it  is 
surprising  how  complex  the  technical  definition  actually  is. 

Sherr  (1979)  defines  luminance  as: 

"The  measure  of  luminous  intensity  of  a  light  emitting 
or  reflecting  surface  in  a  given  direction,  per  unit 
of  projected  area  of  that  surface  as  viewed  from  that 
d i  rc-ct  ion."  (  p  .  3i 

Me  re  simply  put.  luminance  can  be-  thought  of  as  intensity  of 
light  emitted  from  a  given  point  or.  in  short,  phot  onet  rim 
bri  ghtn'-ss. .  Luminance  is  expressed  either  in  foot -Lambert  s  (  fl  )  ^ 
or  i  r,  the-  metric  unit,  t  h*^  nit,  or  candela  per  square  meter  (cc/r.  ). 
A  multi  plie?  of  3.4  is  used  to  convert  from,  foot  -  Lambert  s  to  a  i :  > 


A  visual  displae  must  reach  a  ct rtain  level  of  luminance  tc 
ensure  visihilitv  ( Goul d .  19C8  i  .  Shurtleff  (  1980)  spoci f i es 


10-50  fl  (34-171  mtsi  as  a  minimum,  range  of  luminance  for 
characters  on  a  CRT  screen.  Bean  ( 1980  >  conside  rs  10-100  fl 
(  34-353  ni  ts  )  to  be-  am.  accept  able  range-  for  the  screen  b  a  fil¬ 
er  ound.  Cakir.  et  al  .  <  1PS9  »  set  45  nits  as  the  rr.ir.  imum 

character  luminance  and  80- ICO  nits  as  the  preferr*.  c:  rang-.  . 


> 


Table  4-1  continued 
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Sherr  (1979)  specifies  50  nits  as  an  acceptable  luminance. 
Depending  on  the  levels  of  background  lighting,  unnecessarily 
high  levels  of  luminance  may  cause  viewer  fatigue  and  discomfort 
( Vartabedian ,  1971).  Control  over  the  levels  of  luminance  is 
almost  an  essential  feature  and.  fortunately,  one  that  is 
commonly  available  on  most  visual  display  systems. 

Cont  rast 

Contrast  refers  to  the  difference  in  luminance  between  a  figure 
and  a  ground  on  a  visual  display  (e.g.  between  alphanumeric 
characters  and  the  background  screen).  The  ratio  between  the 
figure  luminance  and  the  ground  luminance  gives  the  contrast 
of  the  display: 


where  C  =  the  contrast  of  a  given  display 

Lf  =  the  luminance  of  the  figure  (or 

the  maximum  luminance  on  the  display) 

L  =  the  luminance  of  the  ground  (or 
®  the  minimum  luminance  on  the  display) 

Visual  displays  must  reach  an  adequate  level  of  contrast  to 
allow  the  image  to  be  clearly  seen  (Bryden.  1969).  Sherr 
(1979)  specifies  a  5:1  contrast  as  minimum.  10:1  preferred. 

Bean  (1980)  concurs,  suggesting  contrast  levels  of  8.5:1  to 
10:1.  Shurtleff  (1980)  offers  evidence  that  contrast  levels 
can  reach  as  low  as  2:1  under  special  conditions,  but  that 
under  sub-optimal  conditions  the  contrast  level  may  need  to 
be  as  high  as  18:1  (cf.  Crook .  Hanson,  and  Weisz,  1954.) 

Because  contrast  is  a  basic  variable  and  interacts  with  other 
factors  such  as  luminance,  background  lighting,  and  blur, 
contrast  control  that  allows  adjustment  to  particular  conditions 
is  a  highly  desirable  feature  of  a  visual  display  system. 

Resol ut i on 

'Resolution'  is  one  of  the  most  ambiguous  terms  in  the  human 
factors  literature.  Basically  defined,  resolution  is  the 
smallest  discernable  detail  in  a  visual  display  (Sherr,  19791 . 
That  is,  resolution  answers  the  question.  How  many  minutes  of 
arc  must  a  visual  element  subtend  to  be  correct  ■ '  and  clearly 
seen0  Sherr  suggests  that  under  normal  viewing  conditions  a 
character  must  subtend  1-3  minutes  of  arc  to  be  clearly  visible 
on  a  CRT  screen.  The  actual  resolution  of  a  particular  display 
will  vary  depending  in  part  on  the  luminance  and  contrast  of  the 
display.  Several  methods  exist  for  measuring  resolution, 
including  the  shrinking  raster  and  television  limiting  techr. iqu-  .- 
(  c.f  •  Sher  r  ,  19  79  ; 


In  addition  to  multiple  techniques  of  measurement,  further 
ambiguity  enters  in  when  'resolution'  is  used  in  another 
sense  meaning  "the  number  of  scan  lines  per  character  height", 
or  in  a  third  sense  meaning  "the  number  of  scan  lines  on  a 
CRT  screen."  To  distinguish  between  these  uses  of  the  term, 
let  us  call  the  second  kind  "character  resolution"  and  the 
third  kind  "screen  resolution".  There  is  general  agreement 
that  characters  need  10-12  raster  lines  to  ensure  legibility. 

As  for  screen  resolution,  generally  the  more  lines  the  better. 
Screens  with  low  resolution  have  a  problem  displaying  diagonal 
lines  because  the  "stairstep  effect" — the  perceived  disconti¬ 
nuity  of  the  line — is  more  severe.  However,  the  screen  rc-solut 
is  oiten  set  at  a  fixec  standard.  TV  broadcasting  sets  the 
number  of  TV  lines  to  525  in  the  U.S.  and  to  625  in  Europe  . 
Since  Sherr  (  1979)  specified  1724  lines  as  the  opt  im.al  screen 
resolution,  the  present  situation  is  considerably  less  than 
optimal  but  adequate  for  many  purposes. 

Viewing  Distance 

In  a  review  of  legibility  factors  for  electronic  displays.  Bear. 
(1980)  calculates  all  his  recommendations  to  a  viewing  distance 
of  28  inches  since  most  working  environments  place  the  worker 
approximately  that  distance  away,  within  arm's  reach  of  the 
screen.  Shurtleff  (1980)  also  uses  28  inches  as  a  standard 
distance  from  the  screen,  but  takes  into  account  possible 
variations  in  distance  at  different  viewing  angles.  The  opt  i  mu. 
viewing  distance  for  a  visual  display  depends  on  the  screen 
size;  the  smaller  the  screen  the  shorter  the  desired  viewing 
distance.  Some  allowance  for  variation  from  the  optimum, 
distance  should  be  made  since  fatigue  can  more  easily  become 
a  problem  if  the  operator  is  required  to  maintain  the  same 
posture  and  viewing  distance  from  the  screen  for  long  periods 
of  time. 


Viewing  Angle 

Seibert,  Hasten  and  Potter  (1959)  provide  evidence  that  no 
loss  of  accuracy  or  speed  occurs  at  viewing  angles  up  to  19 
degrees  off  of  center.  Bean  (1980)  points  out  that  viewing 
angle  should  not  be  a  major  problem,  lor  most  single  station 
operators  because  they  will  be  able  to  adjust  the  angle  to  suit 
their  preference.  Shurtleff  (1980),  however,  takes  a  different 
approach,  considering  the  viewing  angle  to  be  an  important 
consideration  in  the  selection  of  appropriate  display  hardware 
Shurtleff  argues  that  his  development  of  viewing  area  criteria 
"represents  a  unique  and  significant  technical  improvement  in 
the  approach  to  display  selection"  (Shurtleff,  1980,  p.  112  . 
and  that  they  serve  as  a  necessary  adjunct  to  the-  classical 
visibility  criteria  reviewed  in  this  section.  Specif ical  1  y 

the  viewing  area  criteria. . .guarantee  wi de-angle 
viewing  by  stipulating  that  the-  operator  must  be  abb 
to  identify  symbols  when-  (a)  working  at  any  position 
on  the  display  she  lf  and  (b  i  working  at  a  closc-m 
position,  e .  g.  .  arms  or.  the  shelf.  c>r  in  a  relax'd 


position,  e.g.,  sitting  back  in  the  chair  with  arms 
resting  on  the  arms  of  the  chair.  These  criteria 
provide  operators  with  freedom  of  head  and  body  move¬ 
ment  necessary  to  avoid  stretching,  straining  or 
slouching  in  attempting  to  identify  symbology,  all 
of  which  may  result  in  eye  strain  and  muscular 
fat igue . 

Shurt 1 ef f ,  1980 ,  p . 

For  more  detailed  information  concerning  Shurt leff's  approac 
to  viewing  area  requirements,  consult  Shurt leff  (1980),  and 
chapter  5 . 

Viewing  angle  becomes  particularly  important  when  the 
display  is  designed  for  group  viewing,  or  when  the  operator 
is  not  always  stationed  directly  in  front  of  the  display. 
Such  special  cases  in  the  working  environment  should  be 
considered  when  determining  visual  display  specifications. 

Background  Lighting 

Background  lighting  refers  to  the  light  present  in  the 
working  environment.  Although  the  background  lighting  could 
be  expressed  in  terms  of  luminance  (light  emittance)  it  is 
usually  referred  to  in  terms  of  illuminance  (i.e.,  the  amour, 
of  light  received  at  a  given  point).  Cakir  (Cakir.  et  al . . 
1980)  recommends  a  background  illuminance  of  300-500  lux 
(the  non-metric  unit  in  foot -candles )  for  a  CRT  display. 

In  general,  light-emitting  displays  (CRT’s,  plasma  panels, 
etc.)  operate  best  under  low  levels  of  background  lighting 
while  light-controlling  devices  (e.g..  LCD's)  operate  better 
under  higher  levels  of  background  lighting.  Bean  (1980). 
in  comparing  different  kinds  of  output  devices,  states 
that  CRT's  operate  well  under  low  to  medium  background 
lighting  levels.  CRT's  can  usually  be  used  effectively 
under  most  levels  of  background  lighting  typically  encount¬ 
ered  in  working  environments. 

Just  as  important  as  the  amount  of  background  lighting  is 
the  uni f  ormi t  y  of  the  background  lighting.  The  more  uni  for" 
the  background  lighting,  the  more  easily  a  display  message 
can  be  read.  Highly  contrasting  or  irregular  background 
lighting  makes  it  difficult  for  the  eye  to  accomodate  to  the 
display  level  of  luminance  (see  gl a rc  below). 

Direction  of  Contras: 

Direction  of  polarity  of  contrast  refers  to  the  relation.-.*'.:; 
between  figure  and  ground  displays  may  have  a  dark  figur*. 
on  light  background  or  a  light  figure  on  a  dark  background 
Most  CRT’s  present  light  character?  on  a  dark  background.  . 
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probably  more  from  convention  than  from  documented  research 
findings.  Whether  the  dark  background  eases  the  eyestrain 
is  at  present  unknown.  Also,  whether  working  environments 
with  higher  background  lighting  levels  favor  dark  backgrounds 
is  to  our  knowledge  unknown.  Shurtleff  (1980)  suggests  that 
when  viewing  conditions  are  well  below  optimum,  a  switching 
capability  may  be  useful,  allowing  the  user  to  alternate 
between  contrast  directions  at  will.  The  general  consensus, 
however,  is  that  direction  of  contrast  is  not  an  important 
factor. 

Screen  Size 

The  size  and  proportion  of  the  screen  is  of  course  an  important 
consideration.  If  the  display  will  be  used  as  an  input /output 
terminal,  a  smaller  screen  (12-15  inches)  will  usually  be 
sufficient.  Shurtleff  (1980)  suggests  that  larger  screen 
sizes  be  used  for  military  consoles,  and  larger  still  for 
group  or  remote  viewing.  In  many  cases,  group  viewing  requires 
the  use  of  projected  displays. 

In  addition  to  the  general  purpose  of  the  display,  the  amount 
of  information  that  must  be  displayed  at  any  given  time  is  an 
important  considerat ion  in  determining  the  appropriate  screen 
size  (see  display  capacity  below). 

Grav  Scale 

Gray  scale  is  the  term  used  to  refer  to  the  number  of  shades 
or  steps  of  brightness  perceived  by  the  viewer.  Sherr  (1979). 
however,  operationally  defines  "shades  of  gray'  as  a  ratio  of 
1.4  between  two  levels  of  luminance,  objecting  to  the  inaccuracy 
inherent  in  the  "human"  definition  above.  Although  people  can 
discern  up  to  8  levels  of  gray  under  optimal  conditions  off 
line,  this  is  not  true  for  CRT  viewing.  Sherr  (1979)  points 
out  that  only  4  levels  of  gray  can  readily  be  distinguished 
on  CRT’s  by  humans  (Sherr,  1979).  Thus,  following  Sherr ’ s 
usage  of  "shades  of  gray"  to  mean  luminance  ratios  of  1.4. 
he  recommends  that  "gray  levels"  used  for  coding  purposes  be 
two  "shades  of  gray"  apart. 

Cakir.  et  al .  (1980)  note  that  the  number  of  gray  levels  needed 

depends  on  the  kind  of  task  the  user  is  engaged  in.  Many  tasks 
require  no  more  than  two  levels;  for  most  graphi cs  tasks, 
however,  at  least  three-  levels  of  gray  are  recommended. 

Fli cker 

Flicker  is  the  perceived  rapid  dimming  and  brightening  of  a 
visual  image  caused  by  problems  in  the  refreshing  of  the  image  . 
Small  area  flicker,  such  as  the  perceived  movement  of  a 
displayed  pinstripe  suit,  is  more  common  than  the  flicker  of 
the  entire  display.  Prolonged  exposure  to  flicker  results  i  r. 
viewer  irritation  and  fatigue  (Oestborg.  1975).  Two  basic 
factors  affecting  the  presence  or  absence  of  flicker  are  (1 


the  type  of  phosphor  used  on  the  screen  and  (2)  the  refresh 
rate  (the  number  of  refreshings  per  second)  of  the  display 
(Gould,  1968).  Phosphors  differ  in  the  length  of  time  they 
persist  in  emitting  light.  Most  phosphors  commonly  used  on 
CRT's  have  low  to  medium  persistance  rates;  longer  rates  are 
available  but  they  cause  smearing  of  motion  graphics  and 
scrolling.  The  shorter  the  persistance  rate  of  the  phosphor, 
the  faster  the  refresh  rate  required  to  avoid  flicker,  Cakir. 
et  al.  (1980)  sets  the  optimum  range  of  refresh  rate  at 
50-60  Kz.  Since  the  standard  refresh  rate  for  TV  receivers 
in  the  U.S.  is  60  Hz.  there  is  rarely  a  problem  with  flicker. 

Jitter  and  Drift 


Although  flicker  is  the  most  commonly  mentioned  kind  of  image 
instability,  it  is  probably  the  least  frequent  occurring.  Mor 
often,  visual  displays  are  prone  to  varying  degrees  of  jitter 
(rapid  image  movement)  and  drift  (slow  image  movement)  caused 
by  voltage  irregularities  in  the  power  supply.  There  are  no 
easy  solutions  to  image  stability  caused  by  problems  in  the 
power  supply  other  than  careful  inspection  and  maintenance  of 
the  power  source  and  connections  to  the  display  device. 

Blur 

Blur  is  a  defocussing  of  the  stroke  edge  resulting  in  a  lack 
of  sharpness  in  the  visual  image.  It  is  expressed  as  the 
ratio  between  the  observed  width  of  the  transition  gradient 
from  figure  to  ground  and  the  width  of  the  stroke. 

Shurtleff  (1980)  suggests  that  the  legibility  of  characters 
is  not  significantly  reduced  by  blur  levels  of  207  or  less. 

The  harmful  effects  of  blur  can  be  offset  by  increasing  the 
contrast  level  or  by  using  larger  characters. 

Glare 

Glare  is  a  major  problem  encountered  by  visual  display  users 
in  office  environments.  Cakir.  et  al .  (1980)  defines  glare 
as  disturbances  in  the  background  lighting  or  reflected 
disturbances  on  the  screen  that  cause  discomfort  or  impaired 
performance  by  disrupting  the  light  accomodation  of  the  eye 
(see  also  Oestberg.  1975).  Mention  was  made  in  the  discussion 
of  background  lighting  of  the  harmful  effects  of  irregular 
sources  of  light  in  the  working  environment.  Cakir  offers 
four  suggestions  to  reduce  glare: 

•  remove  distracting  light  sources 

•  reposition  the  visual  display  screen: 

9  increase  the  luminance: 

•  use  ant i -ref lect i on  shielding. 

Cakir  recommends  that,  as  a  general  rule,  ant  i -ref  1  ect  i  or. 
types  of  glass  be  used  on  video  terminals  t  o  reduc--  th>. 
ref  lect  ed  gl  arc  . 


Summary  of  Visibility  Factors 


The  most  basic  factors  affecting  the  visibility  of  yisual 
displays  are  the  "classical"  factors  of  luminance,  contrast, 
and  resolution.  These  three  factors  interact  highly  with 
each  other;  nonetheless,  general  recommendations  can  be  made 
for  each. 

•  The  luminance  of  a  visual  display  should  be  at  least 

34  nits  (cd/m,2  j  and  preferrablv  between  50-160  nits.  Luminance 
control  is  highly  desirable. 

•  The  luminance  contrast  of  a  visual  display  should  be 
between  8:1  and  18:1.  Contrast  control  is  also  highly  desirable 

•  Resolut ion :  10-12  raster  lines  should  be  used  to  form 

characters,  resulting  in  characters  subtending  15-30  minutes 
of  arc  from  the  eye.  The  standard  screen  resolution  of  525 
lines  in  the  United  States  is  adequate  for  general  purposes : 
however,  graphics  uses  may  require  screen  resolution  of  1100 
lines  or  higher. 

The  following  visibility  factors  are  not  so  central  but  car. 
still  affect  how  well  an  image  can  be  seen. 

•  The  recommended  viewing  distance  depends  on  the  type 
of  display  (e.g.,  input /output ,  military  console,  or  displays 
for  remote  or  group  viewing).  For  typical  input /output  devices, 
viewing  distance  is  usually  24-28  inches  or  within  arm's  reach. 

•  Viewing  angles  as  much  as  19°  off-center  do  not 
significantly  affect  display  legibility;  greater  angles  may 
require  larger  characters  and  wider  spacing. 

•  The  background  lighting  should  usually  be  low  to 
moderate  for  light-emitting  displays  (100-500  lux),  and  should 
be  as  uniform  as  possible  to  reduce  glare. 

•  The  direction  of  contrast  is  not  an  important  visibility 
factor;  the  common  use  of  white  characters  on  black  background 

is  satisfactory. 

•  The  size  of  the  screen  depends  on  the  display's 
application:  small  screens  (12-15  inches  or  smaller)  are  suitable 
for  input/output  displays  whereas  larger  screens  may  be  needed 
for  remote  or  group  viewing. 

•  For  graphics  displays,  at  least  three  shades  of  pr 
are  recommended .  Two  shades  of  gray,  however,  are  suff ion  r* 
for  most  alphanumeric  presentations.  More  than  four  shad--  o; 
gray  are  probably  unnecessary  because  of  lin.it  at  ions  of  human 
perception . 
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The  following  visibility  factors  represent  kinds  of  problems 
common  to  CRT  screens  particularly. 

•  FI icker ,  one  kind  of  image  instability,  should  be 
avoided  by  increasing  the  refresh  rate,  by  using  a  phosphor 
with  a  longer  persistance  rate,  or  by  decreasing  the  luminance. 
With  a  refresh  rate  of  60  Hz,  common  in  the  United  States, 
flicker  should  not  be  a  major  problem.  Jitter  and  drift  can 
be  corrected  by  stablizing  the  current  of  the  power  source. 

•  Although  blur  levels  of  20  percent  are  greatly  harmful  to 
legibility,  increasing  the  bandwidth  may  help  improve  the 
sharpness  of  edges  on  a  display,  although  at  some  increase  in 
cost . 

•  Glare ,  another  common  problem,  can  be  reduced  by 
removing  distracting  background  light  sources,  repositioning 
the  display  screen,  increasing  the  display  luminance,  or  by 
using  anti-reflection  shielding. 


Legibility 

The  preceding  factors  have  application  to  all  kinds  of  visual 
images,  whether  graphic  or  alphanumeric,  The  following 
factors  specifically  affect  the  legibility  of  alphanumeric 
characters  and  the  readability  of  written  messages. 

Table  4-2  follows  the  text  structure  and  can  be  used  as  a 
concise  summary  of  legibility  factors. 


Character  Subtense  and  Height 

Character  subtense  refers  to  the  size  of  a  character  as 
measured  by  the  minutes  of  arc  it  subtends  from  the  eye. 

Sherr  (1979)  argues  that  since  the  minimum  resolvable' detai 1 
that  humans  can  see  is  approximately  1  min  of  arc,  the  mini¬ 
mum  necessary  size  of  a  7-dot  character  is  7  minutes  of  arc. 
However,  he  specifies  as  a  preierred  character  size  between 
16  and  30  minutes  of  arc.  Cakir.  et  al  (1980)  generally  agree, 
specifying  a  range  of  15-22  minutes  of  arc  as  acceptable  for 
alphanumeric  characters.  Bean  (1980)  cites  two  studies 
(Shurtleff,  et  al .  1977;  Ketchel  and  Jenney .  1968)  in  setting 
15  minutes  of  arc  as  a  minimum  character  size.  Shurtleff 
(1980)  advises  that  under  low  levels  of  luminance  (.01-. 1  fL). 
20  minutes  of  arc  be  used.  However,  for  higher  levels  oi 
luminance  (10-50  fL)  .  character  size  as  low  as  10  minutes  of 
arc  may  be  used.  In  general.  Shurtleff  allows  a  range  between 
10  and  37  minutes  of  arc,  depending  on  the  viewing  conditions. 
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The  actual  size  of  the  character  on  the  screen  is  determined 
by  the  angular  subtense  discussed  above  and  the  viewing 
distance  of  the  user  from  the  screen.  Hence,  if  28  inches 
is  assumed  to  be  the  viewing  distance,  characters  of  .12  to 
.24  inches  w'ould  subtend  15  to  30  min.  of  arc.  This  seems 
to  be  a  generally  accepted  range  of  character  size. 


Character  Generation 


Aside  from  the  characters  formed  by  raster  scan  lines,  the 
three  most  common  methods  for  generating  characters  are 
(1)  dot  matrix,  (2)  fixed  stroke,  and  (3)  random  stroke. 

Dot  matrix  characters  are  formed  by  activating  selected 
dots  in  a  matrix,  commonly  5x7  dots.  Stroke  characters 
are  created  by  fine  resolution  strokes,  produced  in  either  a 
fixed  or  random  format  . 

There  seems  to  be  no  major  difference  in  performance  between 
dot  matrix  and  random  stroke  characters.  Fixed  stroke 
characters  require  more  processing  time  but  are  also  legible 
and  suitable  for  certain  purposes.  Shurtleff  (1980)  recommends 
that  the  dots  in  the  dot  matrix  be  as  round  as  possible  and  as 
continuous  as  possible,  resulting  in  continuous,  smooth¬ 
appearing  lines. 


Font 


Font  refers  to  the  style,  shape,  and  proportion  of  the  alpha¬ 
numeric  character  set.  In  general.  Bean  (1980)  has  found  no 
evidence  to  demonstrate  superiority  of  one  font  over  another 
for  CRT  applications.  He  recommends  that  serifs  (extra 
curls  and  lines  for  accent)  be  avoided  on  CRT's  and  that 
upright  rather  than  slanted  characters  be  used  to  avoid  the 
"stairstep  effect"  caused  by  diagonal  lines  on  raster  screens. 

Regarding  particular  font  styles.  Shurtleff  (1980)  recommends 
the  Lincoln/Mitre  font  because  it  has  been  empirically  refined 
to  reduce  i nter-character  ambiguity.  Bean  (1980)  finds 
acceptable  the  Lincoln/Mitre  font,  as  well  as  the  standard 
Leroy  font  and  the  MIL-M-18012. 

Overall,  several  fonts  could  be  used  effectively  for  visual 
displays,  the  final  decision  resting  primarily  on  aesthetic 
and  logistical  considerations. 


Dot  Matrix  Size 


The  size  of  the  dot  matrix  can  range  from  5x7  through 
7x9,  7  x  11,  9  x  1 1  or  larger.  Shurtleff  (1980)  considers 
the  5x7  matrix  to  be  only  marginally  acceptable;  for  less 
than  optimal  viewing  conditions  hi  recommends  a  7  x  9  or 
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larger  matrix.  Bean  (1980),  Cakir,  et  al  (1980),  and  Sherr 
(1979)  all  agree  that  the  5  x  7  matrix  is  acceptable  for 
most  purposes.  Since  the  5x7  matrix  is  probably  the  most 
common  dot  matrix,  it  would  appear  that  its  use  is  often 
appropriate.  If  viewing  conditions  are  expected  to  be 
significantly  below  optimum,  however,  a  larger  matrix  size 
should  be  considered.  As  display  technology  matures,  the 
frequency  of  use  of  5  x  7  matrices  will  decline.  The  ccst 

differential  between  this  and  larger  matrices  is  lessening 
rapidly  and  esthetic  considerations  greatly  favor  larger 
matrices.  We  therefore  recommend  that  larger  matrices  be 
used  over  5x7  matrices. 


Character  Width  to  Height  Ratio 

The  character  width  to  height  ratio,  also  called  the  character 
aspect  ratio,  refers  to  the  horizontal  vs.  vertical  proportion 
of  the  individual  character.  Shurtleff  (1980)  suggests  that 
the  character  width  should  be  approximately  75 7c  of  the  height. 
Bean's  (.1980)  range  of  50-100*  is  in  general  agreement  with 
Cakir's  (Cakir,  et  al  .  1980)  range  oi  70-807c  and  Sherr 's 
(1979)  of  71-77*.  Buckler  (1977)  concludes  that  character 
aspect  ratio  is  a  relatively  unimportant  legibility  factor, 
and  that  a  rather  broad  range  of  values  is  acceptable. 


Stroke  Width  to  Character  Height  Ratio 


How  thick  should  the  stroke  be  in  relation  to  the  character 
height?  Again,  researchers  generally  agree  that  the  stroke 
should  be  between  12  and  20*  of  the  character  height.  Sherr 
(1979)  suggests  that  in  general,  designers  should  use  the 
thickest  lines  possible,  or  at  any  rate,  not  less  than  10* 
of  the  character  height.  Table  4-2  reviews  other  suggested 
ranges.  The  stroke  width  does  not  seem  to  be  a  critical 
variable  affecting  legibility  provided  a  minimum  width  of 
about  12*  is  obtained. 


Character  Spacing 

Character  spacing  refers  to  the  amount  of  space  between 
characters  on  a  line.  Based  on  evidence  from  Shurtleff  and 
Alexander  (1972)  and  Crook,  et  al ,  (1954).  Bean  (1980) 
recommends  a  character  spacing  range  of  10-1 5r  of  the  symbol 
height.  Cakir,  et  al  (1980)  recommend  that  characters  be 
spaced  20-50*  of  the  character  wi_dt_h .  Sherr  (1979)  finds 
25-65*  of  the  character  height  acceptable.  Shurtleff  (1980) 
suggests  that  for  direct  angle  viewing,  characters  can  be 
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as  close  as  8-107  of  the  symbol  height.  For  extreme  off-axis 
viewing  of  45°  or  more,  25-507  of  the  character  height  is 
recommended.  In  general,  for  subopt imal  conditions,  Shurtleff 
recommends  .spacing  approximately  257  of  the  character  height. 

Spacing  between  lines  or  rows  of  characters  should  be  at 
least  507  of  the  character  height  according  to  Bean  (1980; 
cf.  Streeter,  et  al  ,  1972).  Cakir,  et  al  (1980)  recommend 
a  more  conservative  100-1507  of  char  cter  height. 

Cakir.  et  al  (1980)  also  make  an  important  point  relating  to 
character  si  me  and  character  spacing.  The  optimum  character 
size  or  spacing  for  legibility  (i.e.,  recognizing  individual 
characters)  may  not_  be  optimal  in  terms  of  re  a  dab  i  1  i  t  y  (i.e.. 
comprehending  sentences  in  prose  format).  There  is  a  trade¬ 
off  between  the  clarity  of  individual  characters  and  the 
readability  of  long  strings  of  words.  Large  characters 
with  wide  spacing  may  be  very  legible,  but  the  number  of 
eye  movements  required  to  read  a  passage  may  be  greatly 
increased,  thus  lowering  the  passage's  readability.  This 
tradeoff  should  be  kept  in  mind  when  choosing  a  particular 
character  spacing  level  within  the  ranges  specified  above. 


Display  Capacity 


Display  capacity  refers  to  the  absolute  number  of  characters 
that  can  fit  within  a  given  display  surface.  It  is  a 
function  of  (1)  character  size  and  spacing,  (2)  screen  or 
display  size,  and  in  the  case  of  CRT’s  (3)  the  size  of  the 
margins  on  the  screen's  edge.  The  display  capacity  can  also 
be  thought  of  as  the  product  of  the  maximum  number  of  lines 
times  the  maximum  number  of  characters  per  line.  Sherr  (1979 > 
specifies  a  system  with  25  lines  per  display,  64  characters  per 
line,  resulting  in  a  display  capacity  of  1600  characters  (for 
color  displays )  . 

Although  the  capacity  of  a  display  is  an  important  dimension, 
we  do  not  mean  to  suggest  that  the  formatting  of  content 
should  be  so  densely  packf'd  in.  The  formatting  of  characters 
on  the  display  is  a  completely  independent  issue  and  should 
follow  guideines  from  the  literature  in  various  fields  of 
appl i ed  design . 


C hromat  i  ci  t 

Chromaticity  refers  to  the  choice  of  color  used  as  the  basic 
hue  for  displays  (green,  yellow,  etc.  ).  Research  has  shown 
•  that  yellow,  green  and  white  symbols  near  the  center  of  the 

visual  spectrum  provided  better  performance  than  those  at 
the  extremes  (blue  and  red).  (Shurtleff.  IDSCz  Alexander, 
et  al,  1974;  Snowberg.  1971).  Krebs  et_  a_l_  (  1979)  suggests  tr>; 
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following  guidelines  for  selecting  colors: 

1.  use  no  more  than  four  colors 

2.  use  red,  green,  and  yellow  to  code  a lphanumeri cs 

3.  use  blue  for  large  symbols  or  where  symbol 
identification  is  not  a  problem 

4.  use  white  for  peripheral  signals 

Krebs  (1978)  also  reported  that  red,  white,  and  yellow  symbols 
were  read  at  a  much  higher  rate  than  were  green  and  blue 
symbols  (Meister  and  Sullivan,  1969;  Rizy  ,  1967).  For 
colored  signal  lights  amber,  violet,  and  red  were  spotted 
more  quickly  and  had  the  fewest  identification  errors 
both  with  laboratory  and  flight  performance  tests.  Sherr 
(1979)  finds  all  colors  except  blue  acceptable.  It  is  clear, 
however,  that  any  color  may  be  used  successfully  with  adequate 
levels  of  luminance. 

Letter  Case 

The  case  of  alphabetical  characters  can  be  either  all  capitals 
(upper  case)  or  mixed  upper  and  lower  case  characters.  For 
many  purposes,  uppercase  character  sets  are  adequate;  however,  for 
extensive  prose  reading,  off-line  research  has  shown  that 
mixed  case  characters  improve  performance.  Bean  (1980)  has 
found  no  research  investigating  mixed  case  characters  on 
CRT's  or  other  electronic  displays.  Vartabedian  (1971) 
found  that  on  electronic  displays,  upper-case  words  were  more 
effective  for  visual  search  tasks,  but  that  mixed  case 
format  was  preferred  for  reading  tasks. 

More  research  needs  to  be  done  before  we  know  fully  the  effects 
of  case  on  electronic  displays. 


Summarv  ci  Lepibilitv  Factors 


•  Character  size  is  the  most  important  legibility  factor. 
Alphanumeric  characters  should  subtend  at  least  15-30  minutes 
of  arc  from  the  eye;  thus,  at  28  inches  viewing  distance, 
characters  should  be  .12  to  .24  inches  in  height. 


«  The  dot  matrix  or  random  stroke  methods  of  character 
generat ion  are  preferred  over  fixed  stroke  method.  Fixed 
stroke  characters  are  slightly  less  legible  but  are  also 
accept  able. 


•  Any  of  a  number  of  fonts  are  acceptable  since  insufficient 
research  has  been  done  on  electronic  displays.  Fonts,  however, 
should  avoid  serifs  and  slanted  lines  (to  avoid  the  "stairstep" 
effect).  Good  fonts  include  the  Li ncol n /Mi t re ,  the  Leroy,  and 
the  MI L-M- 18012. 


•  Matrix  size:  Five  by  seven  matrices  are  marginally 
acceptable,  although  they  are  the  most  commonly  used  matrix 
size.  Larger  matrix  sizes,  such  as  7  x  9  or  9  x  11,  are 
preferred,  especially  when  used  with  higher  resolution 
screens . 

•  The  character  width  to  height  ratio  should  be  about 
70-80%;  however,  it  is  not  a  major  factor. 

•  Stroke  to  character  height  ratio:  The  stroke  should 
be  12-20%  of  the  character  height;  generally,  the  thicker 
the  stroke  the  better. 

•  Character  spacing  should  be  at  least  15-25%  of  the 
character  height.  Spacing  between  rows  should  be  50-150% 
of  the  character  height. 

•  The  display  capacity  requirement  depends  on  the 
kind  of  task  the  display  will  be  used  for.  A  common  display 
capacity  will  allow  approximately  1600  characters  to  be 
presented  on  the  screen. 

«  Chromat i ci ty  has  not  been  shown  to  be  an  important  factor. 

•  Letter  case  is  a  factor  not  well  investigated  on 
electronic  displays.  Hard  copy  research  suggests  that  mixed 
case  is  preferred  for  prose  reading  tasks;  however,  this 
finding  has  not  beer,  replicated  on  electronic  displays. 
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CHAPTER  5 

DEVELOPMENT  OF  MATERIALS 


Each  of  the  major  system  types  has  different  development  pro¬ 
cedures  associated  with  it.  These  different  development  pro¬ 
cedures  have  implications  which  must  be  taken  into  account  in 
the  analysis  of  the  hardware.  This  chapter  analyzes  the  various 
development  procedures. 

Analysis  of  Army  Training:  Materials 

There  are  three  general  classes  of  Army  training  materials:  school 
curriculum,  exported  (extension)  training,  and  embedded  training-- 
Computer  Assisted  Instructor  (CAI)  or  Computer- Managed  Instruction 
(C.VI)  embedded  in  operational  equipment.  The  first  category  consist 
of  course  notes,  handouts,  overheads,  and  so  on.  Exported  traimn 
materials  include  Training  Extension  Course  (TEC)  lessons,  Educat i 
Television  (ETY)  program^,  Army  Training  Literature  Program  (ATLP) 
manuals,  Skill  Performance  Aids  (SPA),  Army  Correspondence  Course 
Program  (ACCP)  sub  courses,  and  Skill  Qualification  Test  (SOT) 
materials.  Embedded  training  materials  take  the  form  of  computer 
programs  (except  for  materials  used  in  CMI).  The  major  concern  of 
this  study  is  with  exported  training  materials,  although  embedded 
training  programs  obviously  have  direct  relevance. 

Exported  training  materials  can  be  classified  into  three  major 
types  with  respect  to  electronic  delivery  systems: 

1)  TV  safe  materials  -  This  includes  audiovisual  TEC 
lessons  and  ETY  programs  which  can  be  developed  in 
videodisc  format  relatively  easily. 

2)  Standard  printed  matter  -  This  includes  all  printed 
TEC  lessons,  ATLP,  and  SPA  manuals,  ACCP  material, 
and  SQTs. 

3)  Oversize  printed  matter  -  This  includes  documents 
such  as  large  schematics,  charts  or  maps  which  are 
not  of  a  standard  size. 

The  second  category  of  materials  (i.e.,  standard  printed  matter) 
includes  a  number  of  different  components  such  as  text,  line 
illustrations  (diagrams),  charts,  photos,  and  flowcharts.  Table 
5-1  presents  some  preliminary  data  on  the  relative  frequency 
of  different  components  in  selected  Army  training  materials. 

Note  that  the  categories  are  not  exclusive  (e.g..  a  single  pag-r 
could  include  a  chart  with  an  illustration  in  it).  This  data 
suggests  that  illustrations  are  the  prominent  component  i  r. 
technical  manuals  and  are  quite  frequent  in  ATLP  materials 
such  as  training  circulars  or  field  manuals.  The  data  also 
suggests  that  photography  is  used  quite  infrequently. 
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Text  deserves  some  additional  comments.  Text  is  common  in 
two  forms:  typed  or  typeset.  Typed  print  almost  always  reads 
across  the  full  width  of  the  page  while  typeset  print  is  often 
set  in  two  columns  down  the  page.  Generally  a  manual  will  be 
either  typed  or  typeset  but  sometimes  both  are  found  in  the 
same  manual  (usually  not  on  the  same  page  however).  Caution 
and  warning  notes  in  manuals  are  boxed  and  usually  only  one 
column  in  width.  Notes,  as  well  as  labels  and  call-outs  are 
typically  in  bold  face. 

Color  is  used  in  a  number  of  different  ways  in  printed  matter. 

Its  primary  use  is  to  highlight  or  isolate  a  piece  of  equipment 
or  an  important  heading  or  sentence.  For  example  in  an  illustra¬ 
tion  of  a  piece  of  equipment,  a  particular  part  being  discussed  w 
be  colored,  or  an  important  piece  of  text  (such  as  a  warning)  mat 
be  in  color  or  surrounded  by  a  color  box.  Color  is  also  used  to 
draw  attention  to  important  information  and  to  improve  the 
motivating  aualtities  of  the  material  (i.e.,  by  making  it  more 
visually  stimulating). 


The  implications  of  this  analysis  to  the  development  model  are 
as  follows:  Training  materials  which  are  already  in  T.Y.  safe 
form  or  designed  for  embedded  training  involve  relatively 
straightforward  transformations  for  electronic  delivery  systems 
(EDS).  Materials  which  are  in  print  form  (either  standard  or 
oversize)  require  a  much  more  extensive  transformation  process 
if  they  are  to  be  converted  for  EDS  use.  The  variables  of 
importance  in  such  a  transformation  process  are  the  complexity 
and  size  of  illustrations  and  charts,  the  nature  of  the  print 
(one  column  or  two),  and  the  presence  of  color.  These  variables 
affect  the  capabilities  needed  to  record  and  display  materials 
currently  in  print  form.. 


Analysis  of  Army  Training  Materials  Specifications  and  Peculation 

A  second  important  input  to  EDS  development  models  is  the  existin 
specifications  and  regulations  for  Army  training  materials. 

Table  5-2  provides  a  partial  list  of  some  of  the  documents  applic 
able  to  the  development  of  Army  training  materials.  Many  other 
specifications,  standards,  and  regulations  exist  and  are 
referenced  in  the  documents  listed  in  the  table. 


These  documents  define  the  organization  and  structure  of  Army 
training  manuals.  The  structural  specifications  (i.e..  what 
sections  must  be  present)  would  apply  to  the  development  of 
EDS  materials.  However,  spec i f i cat i ons  and  guidelines  regarding 
the  design  of  illustrations,  page  size,  type  size,  indexing 
schemes,  and  text  preparation  would  not  apply  in  their  present 
form  to  EDS  materials.  In  addition,  there  arc  a  large  number 
of  dynamic  and  interactive  capabilities  which  EDS  present¬ 
ations  would  allow  which  arc-  not  cove  red  1  r.  the  present  re  pul  at  i  • 
For  example  .  text  screens  can  be-  built  up  or.  a  display,  scroll:  ug 
if  possible,  and  text  can  be  made  to  blink  or  move .  Tnus  son- 
aspects  of  current  specifications  guidelines  will  not  applv  tc 
EDS.  and  sortie  EDS  capabi  1  i  ties  will  require  new  spec  i  f  i  cat  :  it.-  . 


Documents 


MIL-’.:- 38  7  84  A 

MI L-.M-63001 

MIL-M-63004 

MIL-M-63035 
M1L-M-63036 
MI  L-V.-63038A 


Ml  L-V.-63040 
MI L-M-63043 
MI L-M-63Q44 
MIL-M-63049 
MIL-M-63050 


MIL-HDBK -63038-1 
MIL-HDBK-63038-2 
TM  38-750 
TC  21-5-3 
AR  611-201 

TRADOC  RFC 
350-100-1 

TRADOC  PAM 
350-30 

TRADOC  REG 

33L-2 


TABLE  5-2 

Applicable  to  the  Development  of 
Army  Training  Materials 


Manuals.  Technical:  General  Style  and 
Format  F.ecui  rement  s 
Manuals.  Technical:  Repair  Parts  anc 
Special  Tools  List 
Manuals.  Technical:  Preparation  of 
Lubrication  Orders 

Manuals.  Technical:  Front  End  Analysis 
Manuals.  Technical:  Operator's,  Preparation  of 
Manuals.  Technical:  Organi zat i oral  or 
Aviation  Unit,  Direct  Support  or  Aviation 
Intermediate,  and  General  Support  Maintenance 
Manuals.  Technical:  Preparation  of  Extension 
Training  Materials 

Manuals.  Technical:  Missile  System  Equipment 
Check  Procedures 

Manuals.  Technical:  Missile  System  Equipment 
Uni  t-l'nder-Test  (Ut'T)  Procedures 
Manuals.  Technical:  List  of  Applicable 
Publications  (L0AP) 

Manuals.  Technical:  Components  of  End 
Item.  Basic  Issue  Items.  Additional 
Authorizations,  and  Expendable  Supplies 
and  Materials  Lists 
Technical  Manual  Writing  Handbook 
Technical  Writing  Style  Guide 
The  Army  Maintenance  Management  System 
TEC  Management  Instructions 
Enlisted  Career  Management  Fields  and 
Military  Occupational  Specialties 

Development.  Implementation  and  Evaluation 
of  Individual  Training 

Interservice  Procedures  for  Instructional 
Systems  Development 

Skill  Qualification  Tests  (SQT)  Policy 
and  Procedures 
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The  capabilities  of  EDS  could  also  change  the  economics  of 
developing  training  materials.  For  example,  the  use  of  color 
is  generally  discouraged  insofar  as  it  requires  approval  of  the 
Office  of  the  Adjutant  General  (AR  310-1).  If  material  is  to  be 
converted  to  videodisc  format  and  presented  via  color  TV  monitors 
the  use  of  color  is  no  more  expensive  than  monochrome  and  there¬ 
fore  may  not  need  to  be  proscribed  as  such.  Similarly,  line 
illustrations  are  recommended  rather  than  photographs,  primarily 
because  of  the  additional  expense  and  difficulty  in  using  photo¬ 
graphs  in  print  media. 

However,  if  material  is  to  be  converted  to  videodisc  format, 
it  may  be  as  easy  and  no  more  expensive  to  use  photographs  as 
illustrations  (depending  upon  the  display  resolution  required). 

If  materials  are  prepared,  stored,  and  distributed  in  electronic 
form,  this  will  undoubtedly  affect  regulations  concerning  revi¬ 
sion.  Thus,  the  use  of  EDS  may  change  the  rationale  underlying 
existing  spec i f i cat  ions  and  regulations  depending  upon  the  type 
of  conversion  approach  followed  (see  next  section). 


Development  Models  for  Existing  Materials 

Three  types  of  development  models  for  converting  existing  materials 
to  EDS  form  are  needed:  one  for  T.Y.  safe-type  materials 
(i.e.,  TEC  audiovisual  lessons.  ETY  programs),  one  for  printed 
materials,  and  one  for  embedded  training  programs.  This  section 
outlines  models  for  each  of  these  three  types. 

TV  Safe  Materials.  Figure  5-1  presents  two  possible  models  for 
converting  TEC  audiovisual  lessons  to  videodisc  format  for  use 
in  an  EDS.  In  the  best  case,  the  16mm  film  master  of  the  TEC 
lesson  is  available  and  can  be  converted  to  videotape  relatively 
inexpensively  and  automatically.  In  the  worst  case  model,  a 
tape  must  be  made  from  the  original  camera  ready  mechanicals 
(CR.Y'3.  and  errors  are  assumed.  The  cost  difference  between  th<" 
best  case  and  worst  case  models  is  estimated  to  be  a  factor  of 
four  times.  Conversion  of  an  ETY  program  is  relatively  simpl* 
and  involves  only  three  steps  (1)  producing  a  3  ’4"  dub  tap<- 
with  visual  S.i'PTE,  (2)  producing  an  edit  log  lor  review  of  tap*--, 
and  (3)  editing  the  master  tarf  to  disc.  The  addition  of  n?v. 
still  frames  represents  an  additional  editing  step. 

WICAT  has  successfully  converted  a  TEC  lesson  from  16mm  film 
form  to  a  2  inch  master  tap'  .  This  process  required  about  2 
hours  of  studio  tiro  for  a  half  hour  lessor.  --  longer  than  had 
been  expected.  Considerable  editing  time  was  required  for  t  iv 
pauses  in  the  lesson.  An  additional  frame  or  text  overlay 
must  be  made  for  each  pause  ("press  next  to  continue").  Presume:  1 
in  an  electronic  delivery  system,  this  pause  would  be  associated 
with  the  entering  of  a  response  and  feedback.  This  experience 
with  TEC  conversion  sugg' -t  s  that  t  he  cost  s  may  be  closer  to  tie 
worst  cast  than  the-  best  cast  estimates  even  when  converted 
directly  frcm  16mm  film. 


BEST  CASE  MODEL 


WORST  CASE  MODEL 
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Print  Materials  ( ATLP . SPA , SQT ' A RTEP ,  ACCP).  The-re  arc-  a  variety 
of  alternatives  for  the  conversion  of  print  materials  to  EDS 
form.  Figure  5-2  presents  the  manual  formatting  approach.  First 
an  edit  log  is  made  from  the  CRM's.  The  text  is  retyped  on  a 
studio  quality  character  generator  and  stored  in  video  form.  The 
original  art  is  either  shot  as  is  or  made  into  multiple  over¬ 
lapping  shots  via  zooming,  in  order  to  achieve  sufficient 
resolution  with  an  KTSC  system.  The  text  and  art  are  then  edited 
together  on  a  premaster  tape  which  can  then  be  mastered  in 
videodisc  form.  The  delivery  system  uses  low  resolution  color 
moni tors . 


Figure  5-3  presents  a  second  approach:  as-is  conversion  using 
high  resolution  1 nput -out put .  The  original  materials  are  shot 
page-f or-page  by  using  a  high  resolution  camera.  The  camera 
output  is  either  converted  to  digital  form  via  digitization, 
sampling,  or  FM  encoding.  The  digital  information  is  then  stored 
on  either  magnetic  or  optical  disk.  The  information  is  then 
converted  or  decoded  back  to  analog  form  for  display  on  a  raster 
type  high  resolution  TV  monitor,  or  displayed  digitally  on  a 
high  resolution  vector  or  storage  display  (bypassing  the  conver¬ 
sion  .•'’decode  step). 

Experiments  3  and  4  of  the  present  study  investigated  the  limits 
of  the  reformatting  and  "as  is"  approaches.  It  was  found  that 
reformatting  text  and  graphics  for  KTSC  video  typically  requires 
a  minimum  of  four  to  five  video  pages  for  each  text  page.  More¬ 
over.  zoom-ins  for  graphics  must  be  so  close  that  an  "establish¬ 
ing"  shot  is  often  needed  to  orient  the  user  to  the  relation  of 
each  portion  of  the  graphic  to  the  whole.  In  order  to  transfer 
an  entire  text  page  to  video  format  intact,  a  minimum  of  approx¬ 
imately  1000  TV  scan  lines  was  required,  at  a  20MHz  bandwidth- 
This  is  far  above  the  525  scan  lines  at  4 . 2MHz  available  on  U.S. 
broadcast  TV. 

A  third  approach  (automatic  reformatting)  is  shown  in  Figure 
5-4.  In  this  method,  an  addressable  camera  is  used  to  digitize 
the  materials.  Under  software  control,  the  original  materials 
can  be  reformatted  during  the  scanning  process  (i.e.,  by  select¬ 
ively  reading  parts  of  the  page)  or  can  be  digitized  completely 
as  is  ar.d  reformatted  before  storing.  The  stored  information 
is  then  converted  back  to  analog  form  and  displayed  on  a  low  or 
medium  resolution  monitor.  In  this  approach  a  page  of  full 
width  text  is  scanned  in  order  to  divide  it  into  quadrants. 

This  is  accomplished  by  spotting  word  boundaries  approximately 
half  way  across  each  line.  Figure  5-5  presents  the  process 
schematically.  The  first  line  is  divided  into  two  parts.  A  and  B. 
These  are  then  presented  sequentially  down  the  page.  Tne  sam-. 
applies  to  otner  full  page  wiatn  lines. 

This  last  alternative  is  being  investigated  by  the  Illinois 
Institute  of  Technology  under  contract  to  ACTO.  A  first  pass 
is  done  in  low  resolution  to  spot  breaks  and  to  generate  computer 
commands.  Then  a  second  pass  at  2000x2000  re-solution  is  performed 
to  digitize-  and  reformat  the-  page-.  The  full  process  takes  from 
20  seconds  to  several  minutes,  depending  on  whether  the  original 
page  is  already  in  columns  or  in  full  width  text.  Graphics  are 
digitized  separately. 
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FIGURE  5-4 

Automat i c  Reformatting  Approach 


Each  of  the  three  alternatives  lor  print  conversion  is  technically 
feasible  but  has  not  yet  been  operationally  demonstrated.  The 
manual  reformatting  approach  is  a  labor-intensive  procedure.  For 
example,  WICAT  reformatted  a  full  page  of  typeset  text  from  a  fiel 
manual  using  a  compositor.  This  took  67  minutes  from  start 
to  completion  and  resulted  in  22  video  frames.  While  this  is 
likely  to  represent  a  worst  case  situation,  it  is  clear  that 
manual  reformatting  will  be  time  consuming. 

The  conversion  and  delivery  equipment  required  for  the  as-is 
approach  is  relatively  expensive  f  conversion  equipment  is  $20- 
$5*0,000;  a  high  resolution  black  and  white  monitor  is  $1,000),  a 
huge  amount  of  memory  is  required  to  digitally  store  text  and 
graphics  unless  character  recognition  is  used  and  graphics  are 
converted  and  stored  as  programs.  This  would  add  a  great  ueal 
of  complexity  and  expense.  However,  the  conversion  process  would 
be  quite  fast  since  it  simply  involves  shooting  the  existing 
CRM's.  In  addition,  a  much  greater  amount  of  information  can 
be  presented  using  the  high  resolution  monitors. 

The  automatic  reformatting  approach  also  involves  expensive 
conversion  equipment  ($20-50,000)  and  decreases  the  labor  required 
for  conversion.  In  addition,  low  or  medium  resolution  monitors 
can  be  used  for  delivery,  making  this  approach  less  expensive 
in  terms  of  delivery  equipment  than  the  as-is  approach.  However, 
because  the  information  is  reformatted,  many  more  pages  of 
inf ormat ion  result  than  the  originals,  and  this  might  result 
in  greater  training  time. 


Until  each  of  these  alternatives  is  operationally  tested,  it  is 
impossible  to  determine  the  best  approach  for  conversion  of 
print  materials  to  electronic  form.. 

Embedded  Training  Materials.  Embedded  training  materials  (CA1 
or  CM1  )  exist  in  the  form  of  computer  programs  for  lesson  present¬ 
ation,  testing,  or  student  management  and  are  presented  on 
operational  equipment.  Provided  that  these  materials  are  in 
languages  available  on  the  electronic  delivery  svstem  and  do  not 
require  the  weapons  system  hardware,  tney  can  be  ,  sed  as-is. 

If  the  language  or  hardware  is  not  available,  then  the  code 
must  be  converted  to  a  language  which  i_s  used.  If  the  embedded 
materials  also  involve  print  or  audiovisual  media,  or  if  audio¬ 
visual  media  are  to  be  adde-d  (e.g.,  on  a  videodisc)  additional 
programming  is  required  to  include  the  frame  addresses  in  the 
programs . 

Obviously,  a  complex  simulation  program  involving  graphics 
would  require  the  equivalent  capabilities  in  t he  new  deliver;, 
system;  hardware  and  software.  1  i  these  capabilities  were  r.«.  *. 
present,  it  is  possible  that  the  graphics  coujd  be  redone  as 
stills  or  animation  sequences  and  stored  on  the  videodisc. 

Cl  earl  v  this  type  of  conversion  would  t>e  expensive  and  compi  leaf  ed 


Recorded  Audio  vs  Synthesized  Audio.  At  the  present  time,  record¬ 
ed  audio  provides  better  quality,  and  is  less  expensive  than 
synthesized  audio.  Note,  however,  that  synthesized  audio  could 
potentially  save  development  costs  since  it  would  be  unnecessary 
to  hire  an  announcer  to  read  a  script.  The  script  could  be  coded 
into  a  program  and  automatically  generated  from  a  digital 
representation.  In  addition,  synthesized  audio  might  make  re¬ 
vision  quicker  and  less  expensive  since  changes  could  be  made 
to  the  digital  representation  rather  than  having  to  re-record. 

For  most  audio  sequences,  recording  is  presently  the  most  cost,' 
effective  means.  However,  there  are  some  situations,  particularly 
with  respect  to  feedback  messages  for  generated  items  (e.g.  ’’The 
answer  36  is  incorrect  .  .  .  the  correct  answer  is  32").  Here 
synthesized  audio  may  be  a  viable  alternative  to  recorded  audio. 

Incut  Mode.  The  development  costs  associated  with  input  mode 
are  primarily  software  costs.  For  simple  input  (yes/no,  A,  B,  C, 
D,  etc.)  the  programming  is  about  the  same.  Thus,  the  code  re¬ 
quired  for  processing  a  single  key  entry  is  about  the  same  as 
that  required  to  identify  an  X-Y  position  on  a  touch  screen,  and 
about  the  same  as  testing  a  match  for  a  single  word  utterance 
from  a  voice  input  system.  Input  from  special  purpose  controls 
often  involves  analog  to  digital  conversion. 

The  useofahigh  level  authoring  system  which  automatically 
generates  the  appropriate  code  for  handling  input  may  eliminate 
the  differences  between  input  modes.  Of  course,  the  time  required 
to  develop  the  authoring  system  would  reflect  the  differences. 


Development  Models  for  New  Materials 


The  previous  section  dealt  with  development  models  for  conversion 
of  existing  materials.  However,  consideration  should  also  be 
given  to  models  for  developing  new  materials  for  electronic 
delivery  systems. 

Figures  5-6  and  5-7  depict  some  of  the  alternative  methods 
possible  for  producing  materials.  Text  can  be  entered  into  a 
word  processing  system  or  a  video  character  generator  for  digital 
or  video  format  respectively.  From  the  word  processor,  the 
materials-  can  be  printed  out  and  distributed  in  paper  form,  or 
stored  in  magnetic  form  for  electronic  distribution  and  display. 
Graphics  can  be  shot  with  a  camera  (original  art  or  photograph.-) 
for  video  format  and  videodisc  storage,  digitized  for  magnetic 
storage,  or  computer  generated  (i.e.,  animation)  for  magnetic 
storage  . 


The  dotted  lines  in  Figures  5-6  and  5-7  show  possible  but  les? 
likely  alternatives..  For  example,  while  videodisc  is  likely  tc 
be  physically  distributed,  the  information  it  contains  could  be 
distributed  electronically.  Digital  information  could  b*  stone 
or.  videodiscs.  Although  magn'-i  i  cal  1  y  stored  information  can  be 
physical ly  distributed,  it  is  more  likely  to  be  distributed 
electronically  (at  least  in  the  mid  to  late  80’s).  Finall;. 
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Figure  5-7.  Alternative  Methods  For  Creating  New  Materials 
For  Electronic  Delivery  Systems:  Graphics 


note  that  there  are  many  alternatives  not  shown-- i ndoed  print, 
video  and  ;’gital  information  can  be  converted  as  discussed  in 
the  previous  section. 

All  of  the  possible  approaches  presented  in  Figures  5-6  and  5-7 
are  likely  to  be  viable  for  different  applications  and  development 
scenarios.  For  the  development  of  TEC  materials  to  be  stored  on 
videodiscs  and  delivered  el ec t roni cal  1 y ,  a  sensible  approach  is 
to  prepare  the  text  by  video  character  generator,  record  the  audio 
and  shoot  static  and  dynamic  graphics  via  camera  so  that  all 
materials  are  in  video  form.  For  the  development  of  training 
manuals,  it  might  be  best  to  create  the  text  via  word  processing, 
and  produce  the  graphics  via  digitization 

or  computer  so  that  all  materials  are  in  digital  form  for 
electronic  or  physical  (paper)  delivery.  The  development  of  a 
simulation  program  for  t-mbodded  training  which  involves  both 
videodisc  and  computer  generated  displays  is  likely  to  involve 
the  use  of  a  video  character  generator,  synthesized  audio,  and 
both  camera-produced  and  computer-generated  graphics. 

Thus,  different  development  approaches  are  likely  to  be  required 
(or  most  cost-effective)  for  different  training  appl ications . 

These  different  development  approaches  may  be  made  relatively 
transparent  to  the  developer  by  use  of  a  sophisticated  authoring 
system..  Such  an  authoring  system  allows  the  developer  to  create 
and  modify  a  lesson  (including  graphics  and  interactive  sequences) 
at  a  fully  equipped  authoring  station  without  concern  for  the 
details  of  how  the  materials  are  actually  developed.  The 
author  enters  the  lesson  content,  prepares  static  and  animated 
graphics,  specifies  audio  sequences,  and  describes  the  inter¬ 
active  logic.  The  authoring  system  then  aids  the  necessary 
intermediate  production  steps  for  producing  print,  video,  or 
digital  ma*  er i als  . 


INPUT  DEVICES  FOR  ELECTRONIC  DELIVERY  SYSTEMS 


Input  devices  are  used  to  enter  data  or  control  electronic 
delivery  systems.  The  most  common  input  device  is  the  com¬ 
puter  keyboard.  However,  a  wide  variety  of  other  input  de¬ 
vices  have  been  developed  and  used  for  particular  applica¬ 
tions.  Many  of  the  input  devices  discussed  below  could  be 
used  for  different  tasks  within  each  scenario.  The  selection 
of  the  input  devices  most  appropriate  for  each  scenario  depends 
on  the  particular  tasks,  data  input  constraints,  and  environ¬ 
mental  situations  in  which  the  device  will  be  used. 

Alternative  Input  Devices 


A  representative  list  of  alternative  input  devices  includes 
keyboards,  keypads,  voice  recognition  systems,  touch  panels, 
light  pens,  joysticks,  trackball,  mouses,  graphics  input 
tablets,  switches,  optical  character  recognition  systems, 
optical  scan  sheet  readers, punched  card  readers,  magnetic 
card  readers,  and  bar  code  readers.  Many  of  these  devices 
have  wide  applications  for  electronic  delivery  systems,  but 
some  are  restricted  to  only  a  few  cases.  Here  we  address  those 
devices  with  the  widest  applications.  Figures  6-1  through  6-7 
provide  a  sample  of  the  input  devices. 

Sherr  (1979)  presents  the  manor  comparison  parameters  for  graphic 
input  devices.  That  work  indicates  that  the  trackball  car. 
provide  the  best  resolution,  linearity,  and  ruggedness.  The 
joystick  emits  pulses  based  on  the  deviation  angle  of  the 
joystick  from  an  upright  position.  The  trackball,  however,  emits 
pulses  whenever  it  is  rolled.  Data  tablets  can  provide  good 
resolution  and  the  writing  and  drawing  motion  is  very  natural. 
Light  pens  are  easy  to  use  but  have  limits  in  speed,  accuracy, 
and  ruggedness. 

Comparisons  Among  Input  Devices 

There  is  little  research  comparing  the  effectiveness  and  effi¬ 
ciency  of  alternative  input  devices  across  a  wide  variety  of 
input  tasks.  The  research  which  has  .  e-_-n  done  does  yield  some 
tentative  comparisons  among  various  input  devices. 

Voice  input  should  be  more  effective  and  efficient  for  inter¬ 
active  problem,  solving  than  keyboards  or  handwriting  (Chapan:.-. 
1975.  1976:  Chapan is .  Ochsman .  Parrish  and  Weeks.  1972.  1977. 
Fore,  1977.  Weeks  and  Chapar.i  s .  1976;. 

Hanes  and  Kink*  ad  (1971  >  found  that  optical  character  recog¬ 
nition  systems  allowed  faster  data  entry  and  fewer  errors  than, 
keyboard  input.  Touch  ton*-  and  digit  keypads  are  very  efficient 
and  effective  for  nun* rical  input  (Conrad.  1966:  Conrad  and  Hu!  . . 
1968;  .  Touch  panel  input  is  faster  than  keyboard  input  for 
entering  cursor  control  information  (Far!  and  Goff,  196o.. 


Figure  6-3.  A  typical  militarized 
keypad  (embedded  in  a  data  entry 
device  ) . 


ablet,  but 
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nong  graphics  input  devices  the  mouse  was  fastest  with  fewer 
errors  when  compared  with  the  lightpen,  joystick,  trackball, 
knee  control,  and  graphics  tablet  (Card,  English  and  Burr,  n.d.; 
English,  Englehart  and  Huddart ,  1965;  English,  Englehart ,  and 
Berman ,  1965 ) . 

Touch  panels  were  faster  than  rotary  dials  (Heglin,  Sabeh  and 
Driver,  1972).  Light  pens  and  light  guns  were  faster  than 
keyboard  for  cursor  control  (Goodwin,  1975).  The  trackball  gave 
the  best  overall  control  for  drawing  straight  lines  and  circles 
when  compared  with  light  pens  and  joysticks  (Irving,  Horinet, 
Walsh,  and  Chan,  1976). 

Engel  and  Granda  (1975)  provide  an  excellent  summary  of  the 
comparative  advantages  and  disadvantages  of  alternative  input 
devices.  Table  6-1  presents  their  findings. 

Table  6-1 

Comparison  of  Alternative  Input  Devices 
(Engel  and  Granda,  1975) 


Lightpen 


Advantages : 

•  Fast  for  simple  input. 

•  Good  for  tracking  moving  objects. 

•  Minimal  perceptual -motor  skill  needed. 

•  Good  for  gross  drawing. 

•  Low  error  rate,  if  properly  implemented. 

•  Efficient  for  successive  multiple  selections,  if  positions 

known . 

•  User  does  not  have  to  scan  to  find  a  cursor  somewhere  on 

the  screen. 

Disadvantages : 

Does  not  feel  natural  to  user,  like  a  real  pen  or  pencil. 
Lacks  precision  because  of  the  pen's  aperture,  distance 
from  the  CRT/screen  surface,  and  parallax. 

Contact  with  the  computer  may  be  lost  unintentionally. 
Frequently  required  simultaneous  button  depression  can 
cause  slippage  and  inaccuracy. 

Must  be  attached  to  terminal,  which  may  be  inconvenient . 
Glare  problems  if  tube  tilted  to  optimal  angle. 

Fatiguing  if  tube  90  degrees  to  work-surface. 

Must  make  bright  target  on  screen,  unless  the  screen  is 
al ready  lighted. 

One-to-one  input  only  ( no  vernier  capability). 

Cumbersome  to  uf-e  with,  alternate,  lrrompat  ible  entry  methods 
such  as  ko;.  board. 

Awkward  or  difficult  for  1  eft -handed  users. 

Obstructs  portion  c * f  screen  when  used. 

Tends  to  be  !•  r  purpose:-  other  than  originally  intended 

(for  ox  art :  le  .  for  k«-y  at  press  ion:. 

Care  must  b<-  tab  n  to  pre.v :  :i*  adequate  "activate-'  area 
around  dr. :  <-e  p 

Slow,  if  r\ar,\  logic  a)  .  scattered  choices  be  made. 


•  Cannot  be  used  on  gas  panel 


Joystick/Track( bowling )  Ball /Mouse 
Advantages  : 

•  Very  accurate  with  high  resolution. 

•  Can  be  used  comfortably,  with  minimum  arm  fatique. 

•  Does  not  cover  parts  of  screen  in  use. 

•  Expansion/contraction  of  cursor  movement  possible. 

•  Joystick  and  track  ball  can  be  attached  to  and  used  near 

to  the  keyboard. 

•  Ball  excellent  for  three-dimensional  rotation  of  objects 

(not  of  cursor ) . 

Pi sadvant ages : 


•  Slower  than  ligntpen  for  simple  input. 

•  Must  be  attached,  but  not  to  display. 

•  Unless  large  joystick,  inadequate  control/display  ratio 

with  positional  control.  Ratio  adequate  with  rate 
control.  The  displacement  of  the  stick  controls  both 
the  direction  and  the  speed  of  cursor  movement. 

•  Difficult  to  use  for  free-hand,  graphic  input. 

•  Inconveninent  to  have  integrated  "activate"  switch  with 

ball. 

•  Mouse  requires  additional  workspace  surface. 

•  Mouse  requires  removal  of  hand  from  keyboard. 

Stylus  with  Tablet 


Advantages : 

•  Excellent  for  graphic  entry. 

•  User  works  on  horizontal  surface. 

•  Multi-purpose  input  device 

•  Expansion / contract  ion  of  cursor  movement  possible. 
Disadvantages : 


•  Extra  space  required  or  work  surface. 

•  May  have  coordination  problem  due  to  displacement  of 

visual  feedback  of  motor  activity. 

Keyboard  (Function  Keys'. 


Advantages  : 


•  Close  at  hand  if  user  typing. 

•  OK  for  text  editing. 

Pi sadvar t ages 

•  Fine  resolution  difficult. 

•  Limited  control  in  most  cases,  usually  in  increments  of 

one  character. 

•  Limited  motion  unless  c horded  input  acceptable,  but  t  her. 

requires  long  training  time  and  skill  to  operate,  and 
error  rate  is  high  ( ICC  ; 


•  Cannot  enter  graphics. 


Engel  and  Granda  (1975)  summarize  their  recommendations  about 
the  various  input  devices  as  follows: 

"While  this  list  of  advantages  and  disadvantages  is 
not  exhaustive,  conclusions  may  be  drawn  from  it  which 
can  be  verified  with  future  research.  The  light  and 
selector  pens  have  few  of  the  desirable  features  which 
were  listed  in  the  introductory  section  of  this  report; 
they  have  many  disadvantages  that  would  preclude  them 
from  being  used  effectively  and  effortlessly  by  users 
in  a  wide  variety  of  applications.  The  bowling  (track) 
ball,  unless  very  large,  would  probably  be  too  slow, 
given  the  recommended  requirements  for  control /display 
ratio.  There  is  also  the  problem  of  placing  an  "activate' 
switch  on  or  under  the  ball.  The  mouse  must  be  used  on 
a  flat  work  surface,  which  may  be  impractical.  In  ad¬ 
dition,  a  user  would  have  to  remove  the  hands  from  the 
keyboard  to  use  it  ( assurni ng  that  alphanumeric  entries 
are  necessary ) . " 

"  The  stylus  with  digitizer  is  versatile,  but  requires 
extra  space  on  the  workspace  and  probably  could  not  be 
moved  around  easily  (for  example,  away  from  the  screen). 
Keyboard  controls  are  sufficient  for  rough  positioning, 
but  some  other  method  is  needed  for  precise  cursor 
placement,  especially  when  a  customer  is  paying  for  an 
all-points  addressable  feature." 

"From  an  overall  human  factors  viewpoint,  the  joystick 
appears  to  be  the  best  control  method,  in  ease  of  use, 
in  control  response  characteristics,  and  in  range  of 
applications.  It  has  long  been  used  as  a  control  device, 
and  a  number  of  satisfactory  guidelines  and  design 
parameters  exist  for  its  use.  Its  responses  can  be 
internally  modified  so  that  a  user  can  control  externally 
the  relationship  between  control  movement  and  display 
movement  (referring,  for  example,  to  correspondence  to  a 
vernier  capability).  It  can  be  attached  by  a  connecting 
cable  to  the  terminal,  and  the  user  is  not  tied  to  a  given 
distance  from  the  screen.  It  is  accurate,  especially 
with  vernier  capability." 


.Additional  research  on  graphics  input  devices  can  be  found 
in  Shapley  and  Shipley.  1970;  Prince,  1971;  Ritchie  and  Turner 
1975:  Walker,  Gurd  and  Drawneek,  1975. 

Ramsey  et .  al . ,  (1978)  and  Ramsey  and  Atwood  (1979)  provide 
an  excellent  summary  of  tne  research  comparing  alternative  ;r.p 
devices.  Table  6-2  presents  thf-ir  results. 

The  table  points  out  that  the  selection  of  an  input  device  is 
dependent  on  the  particular  input  task  and  environment  in  whic 
the  device  will  be  used.  There  does  not  appear  to  be  a  best 
input  device  for  all  tasks  and  situations.  Foley  and  Wallace 
(1974)  and  Wallace  (1976)  suggest  the  need  for  modular,  virtua 


Input  Pevlr.e  Types  (P.ipe  7  of  3) 
(  1  mm  Uiimsc'v  ,  1979) 


device  Typos  (Concl wled ) 
(  I  rom  linriifioy  ,  1  !>7!> ) 
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or  generic  input  devices  and  tasks  which  are  then  controlled 
by  the  interactive  software.  Ramsey  (1979)  suggests  that 
there  are  five  major  types  of  input  tasks. 

1 .  Text  input 

2.  Numerical  input 

3.  Command  selection 

4.  Discrete  position  (graphical)  input 

5.  Continuous  position  (graphical)  input 

Knowing  what  the  input  task  is  helps  in  the  selection  of  the 
input  device(s)  which  will  be  most  useful,  efficient  and  effective. 
If  large  amounts  of  text  are  to  be  input  then  an  alphabetic 
keyboard  is  needed.  Lightpens.  trackballs,  joysticks,  and 
graphics  tablets  would  be  virtually  useless.  For  limited  typing, 
keypads  or  touch  panels  would  be  useful.  Optical  character 
recognition  systems  could  be  used  to  input  full  pages  of  text 
or  handwritten  documents.  Research  on  optical  character  recog¬ 
nition  done  in  the  mid  1960's  showed  that  input  rates  were 
slower  than  unskilled  typing  (Devoe,  1967;  Masterson  and  Hirsch, 
1962).  However  recent  advances  have  made  optical  character 
recognition  systems  much  more  efficient  and  effective.  Very 
little  comparative  research  has  been  conducted  on  these  new 
character  recognition  systems. 

Numerical  input  would  likely  be  most  effective  and  efficient 
using  touch  tone  keypads,  numerical  keypads,  or  voice  recog¬ 
nition  input . 

Graphics  positional  input  (either  discrete  or  continuous) 
requires  the  use  of  a  graphical  input  device.  The  lightpen, 
joystick,  trackball,  mouse,  graphical  input  tablet  or  touch 
panel  could  be  used.  Selection  of  the  best  device  depends  on 
a  thorough  analysis  of  the  task  and  environmental  constraints. 

Ramsey  (1979)  notes  that  there  is  a  large  body  of  research 
on  input  devices,  but  the  majority  of  the  research  has  been 
restricted  to  the  computer  keyboard  as  an  input  device.  The 
research  on  other  input  devices  is  rather  limited.  The  majority 
of  such  studies  compare  the  speed  and  accuracy  of  only  a  few 
of  the  input  devices  on  a  specific  research  task.  Although 
these  studies  do  provide  some  general  suggestions  about  the 
effectiveness  of  the  alternative  input  devices,  they  do  not 
allow  for  the  preparation  of  specific  guidelines  for  selecting 
and  designing  input  devices. 

K eyboard  Rese arch  Dev elopmen t 


Aid:  a.  Daniels  and  Kanariels  (1972)  suggest  that  the  major 
human  factor  issues  in  keyboards  are  concerned  with  key 
dimensions  (.5  inch  diameter,  .75  center  to  center  spacing:, 
key  force  and  displacement  (.9  to  5.3  oz  force  and  .05  to 
.25  inch  displacement ) ,  tactile  feedback,  keyboard  size,  numeric 
cluster  arrangement  and  benefits  of  chorded  rather  than  key  b\ 
key  sequential  entry.  Hanes  (1975)  and  Cakir.  Hart  and  Stewart, 
1979,  also  provide  excellent  reviews  of  issues  in  keyboard  des:  rt. 
and  use.  Martin  (1973)  and  Burch  and  Stratler  (1974)  discuss 
the  benefits  of  special  function  keys. 


Cakir,  Hart  and  Stewart  (1979)  list  the  following  parameters 
which  affect  the  feel  and  useability  of  the  keyboard. 


PARAMETERS 


SPECIFICATIONS 


Shape  and  profile  of  key  tops 
Keyboard  profile 

Keyboard  thickness 
Dimensions  of  Keys 

Size  and  coding  of  key  legends 

Key  force  and  travel 

Tactile  feedback 

Key  roll  characteristics 

Color  and  reflection  of  key 
and  keyboard  surfaces 


Square  shaped  keys  are 
preferred . 

Keyboard  angle  should  be 
5  to  15  degrees 
30mm  from  base  to  home 
key row 

Square  keys  12-1 5mm 

center  spacing  18 -2 0mm. 

User  programmable  keys 
are  beneficial 
Force  100-300  grams 
Di spl acement  4  to  Smm 
Useful  for  inexperienced 
users 

Error  rates  30C  lower  with 
rollover  or  chorded  keys 
which  store  all  key  strokes 
Glossy  reflective  keys  cause 
less  fatique  and  headaches 
t han  mat te  f i n i shed  keys. 

Grey  or  light  colored  keys 
are  more  effective  than  black 
or  dark  colored  keys. 


Keyboard  Layout 


The  major  factors  which  should  be  considered  in  the  keyboard 
arrangement  are  as  follows  (Cakir.  Hart  and  Stewart,  1979 j: 

•  operation  of  the  keyboard  should  require  as  many  changes 
from  one  hand  to  the  other  as  possible. 

•  the  letters  in  the  home  row  of  keys  should  include  those 
which  occur  most  frequently  in  the  language. 

•  there  should  be  a  roughly  even  distribution  of  load  be¬ 
tween  the  right  and  left  hands  but  with  slight  emphasis 
on  the  right  hand. 

•  the  distribution  of  load  on  the  key  rows  should  give 
emphasis  to  the  home  row.  then  to  the  top  and  bottom  rows 
in  that  order. 

•  the  least  use  should  be  marie  of  the  ring  and  little  finger.-, 
i.e.  the  keys  at  the  ends  of  each  row  should  correspond  to 
the  least  frequently  occurring  letters  in  the  language. 

»  the  number  of  keying  sequences  requiring  the  consecutive  us- 
of  the  middle  'ring  and  ring  little  fingers  should  be  kept 
to  a  minimum. 
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•  wide  and  awkward  spans  of  the  fingers  on  each  hand 
should  be  avoided  or  at  least  kept  to  a  minimum. 

Three  major  keyboard  arrangements  have  been  proposed:  thc- 
standard  QWERTY  layout,  the  Dvorak  keyboard,  and  the  Me i r 
keyboard  (Cakir,  Hart  and  Stewart,  1979).  Kroemer  (1972)  also 
proposed  an  alternative  keyboard  design  in  which  the  keys  are 
separated  into  two  subkeyboards--one  for  each  hand.  The  separate 
hand  keyboards  are  at  angles  designed  for  ease  of  typing  at 
normal  arm  levels.  Although  advantages  are  claimed  for  each 
of  the  keyboards,  the  standard  QWERTY'  layout  has  survived  and 
become  the  de  facto  standard  for  keyboards.  The  keyboard 
recommended  for  use  in  the  Spacelab  Data  Display  System  includes 
the  standard  keyboard,  three  dedicated  function  keys,  and  25 
programmable  function  keys. 

The  major  numeric  key  layouts  are  the  touch  tone  arrangement 
and  the  adding  machine  layout.  For  inexperienced  users  the 
telephone  layout  is  more  effective. 

The  combination  of  a  standard  QWERTY  keyboard  with  a  function 
keypad  is  common.  Programmable  function  keys  permit  the  same 
key  to  call  forth  different  functions  in  different  programs; 
this  can  significantly  extend  the  usefulness  of  the  function 
keypad . 
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Hand  Held  Keypads  and  Keyboards 


Hand  Held  keypads  are  very  frequently  used  in  hand  calculators, 
remote  controls  (TV),  and  electronic  games.  Business  and 
industry  have  started  to  use  hand  held  terminals  for  point  of 
sales  use.  Recent  videodisc  players  also  use  hand  held  control 
units  for  videodisc  control.  In  addition,  WICAT  has  developed 
a  keypad  for  controlling  an  interactive  videodisc  system.  A 
recent  issue  of  BYTE  (January  1981)  had  a  special  report  on 
hand  held  computers.  Figure  6-8  presents  a  typical  hand  held 
computer . 

New  Keyboard  and  Key  Developments 


Recent  use  of  hardened  plastic  membrane  switches  and  plastic 
keys  allow  for  the  preparation  of  membrane  keyboards  with 
the  feel  of  spring  loaded  keys.  The  cost  for  OEY  qualities  will 
be  $20-$30  for  a  59  key  keyboard  (Ohr,  1980). 

Solid  State  Technology  recently  announced  the  sale  of  a  Proteus 
terminal.  Like  the  Greek  god  namesake,  the  terminal  enables 
a  user  to  modify  the  form  of  the  input  device  to  match  any 
occasion.  Instead  of  a  standard  keyboard  the  user  develops 
customized  keyboard  layouts  whenever  needed.  The  newly  designed 
keyboard  layout  can  be  activated  through  a  touch  sensitive 
overlay  panel  for  a  CRT  screen.  "Programmers  can  arbitrarily 
assign  any  meaning  to  any  symbol  making  a  character  stand  for 
a  whole  instruction  set.  a  subroutine,  or  a  program.  (Lowe.  1980) 
New  keyboards  can  be  designed  in  about  five  minutes,  it  is  claimed 

Voice  Input 


Voice  input  is  especially  useful  where  hand  or  eyes  are  busy. 

An  example  is  a  maintenance  aiding  task,  where  the  soldier  car. 
ask  verbally  for  a  new  page  of  a  technical  manual  to  be  presented 
or  for  other  information.  Speech  is  a  natural  means  of  communi¬ 
cations  for  untrained  soldiers  who  cannot  type.  High  quality 
voice  input  units  are  more  accurate  than  typing,  although  there 
is  a  wide  range  of  recognition  accuracy  available  in  the  market¬ 
place.  Voice  input  also  permits  greater  mobility  than  a  keyboard* 
For  example,  the  voice  input  system  can  use  a  radio  to  transmit 
over  short  distances,  thereby  freeing  the  soldier  from  distracting 
and  annoying  wires  leading  back  to  the  voice  input  unit. 

There  is  a  wide  range  of  voice  input  recognition  accuracy  and 
cost.  The  price  ranges  from  a  few  hundred  dollars  to  well  our 
sixty  thousand  dollars  for  individual  units.  These  cost  differ¬ 
ences  are  primarily  related  to  two  factors:  The  first  is 
recognition  accuracy  and  the  second  is  the  ability  to  distinguish 
words  separated  by  very  brief  pauses. 

After  reviewing  many  commercial  systems,  discussing  capabi  1  it  :e 
of  voice  input  systems  with  current  users,  and  reviewing  the 
literature  (see  for  example.  Lea.  1980  or  Levin-*. r.  and  L; rm..r  . 
1981)  we  have  concluded  that  the  majority  of  current  voice 
input  systems  are  virtually  useless  for  most  military  application.- 
because  of  their  limited  recognition  accuracy.  Units  with 
sufficient  accuracy  for  widespread  use  typically  cost  more  than 
seventy- five  hundred  dollars  tod  a;.  . 
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Figure  6-8.  A  typical  hand  held  computer. 
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It  should  be  noted  that  recognition  accuracy  bears  little 
resemblance  to  the  published  reports  of  the  manufacturers. 

One  must  see  the  units  in  action  or  talk  with  knowledgeable 
users  to  gain  a  true  picture  of  how  the  system  performs  in 
the  field. 

The  other  major  determinant  of  cost  is  the  ability  to  recognize 
words  which  are  separated  by  very  short  pauses.  In  our  normal 
speech,  words  are  seldom  separated  by  pauses.  Instead,  we 
speak  in  an  almost  continuous  string,  which  others  can  under¬ 
stand  only  because  they  are  able  to  use  many  cues  and  expect¬ 
ations  to  decipher  the  word  string.  For  example,  when  we  say. 

"I  made  a  deposit  at  the  _ "  we  can  fill  in  a  number  of 

plausible  words,  and  even  rank  them  in  order  of  likelihood. 

Without  this  ability  to  use  non-verbal  cues  and 
expectations  based  upon  what  is  being  said,  voice  recognition 
systems  are  at  a  great  disadvantage  in  relation  to  human 
listeners . 

The  problem  of  separating  words  is  further  complicated  by  the 
fact  that  many  silences  occur  within  individual  weeds.  It  is 
not  uncommon  to  find  a  silence  of  90-1 00  mi  1  li seconds  within 
a  word,  but  a  much  shorter  pause,  if  any,  between  words.  For 
this  reason  most  voice  input  systems  are  limited  to  recognizing 
isolated  words.  "Isolated"  is  defined  as  a  pause  of  greater 
than  approximately  120  milliseconds .  In  essence,  words  must 
be  spoken  one  at  a  time. 

A  few  of  the  more  expensive  systems  now  permit  connected  speech 
recognition.  In  this  system,  the  pause  between  words  can  be 
shortened  considerably,  and  can  even  less  than  the  90  to  100 
millisecond  silences  found  within  words.  In  order  to  accomplish 
this,  the  voice  recognition  system  must  try  to  match  words  at 
every  silence.  Since  it  cannot  know  whether  the  silence  is 
within  a  word  or  between  words,  the  system  must  compare  the  words 
which  it  expects  against  each  portion  of  the  speech  string,  and  must 
attempt  different  combinations  of  the  speech  sounds  which  are 
separated  by  short  silences  in  order  to  try  to  find  a  match.  This 
requires  considerable  processing  power. 

Ultimately  a  system  to  recognize  continuous ( normal )  speech  will 
be  designed  and  built.  Such  a  system  will  almost  certainly 
need  to  "understand"  what  it  is  hearing.  This  capability  has 
been  pursued  for  decades,  and  still  appears  to  be  years  away 
from  a  commerc i al  realization. 

The  majority  of  current  voice  recognition  systems  are  speaker 
dependent  .  This  means  that  each  user  of  the  system,  must  train 
it  for  every  word  that  is  to  be  recognized.  The  training 
usually  consists  of  ten  repetitions  of  the  word  or  other  utter¬ 
ance.  Utterances  can  be  up  to  two  to  three  seconds  each. 

This  permits  recognition  of  short  phrases  up  to  three  or  four 
words  in  length  which  will  always  be  treated  as  a  unit.  A  few 
systems  have  been  designed  to  be  speaker  independent .  These 
systems  are  usually  very  expensive  and  quite  limited  in  tin 
number  of  words  which  they  will  recognize  .  Speak*  r  depend*,  r. 
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systems  will  recognize  between  approximately  forty  and  three 
hundred  words,  depending  upon  options. 

In  sum,  the  voice  recognition  system  most  likely  to  be  feasible 
for  Army  use  in  1985  is  a  high  aual ity,  speaker  dependent,  isolated 
•  or  connected  word  unit.  This  type  of  unit  is  commonly  used 

today  for  voice  controlled  numerical  machine  programming,  for 
sorting  packages  at  shipping  docks,  and  for  quality  control 
inspections.  In  the  Army  it  can  be  used  for  these  applications 
as  well  as  for  simulations  of  voice-dependent  operator  tasks 
and  for  maintenance  aiding. 


CHAPTER  7 


DISPLAY  DEVICES  FOR  ELECTRONIC  DELIVERY  SYSTEMS 

Output  devices  are  computer  peripheral  devices  which  display  alphanumeric 
graphical  or  realistic  visual  information  from  interactive  systems.  The 
three  major  classifications  of  output  devices  presented  below  will  be 
considered  In  this  chapter. 

1.  Teletypewriters,  printers  and  word  processors  which  provide 
hard  copy  output. 

2.  Cathode  ray  rules  (CRT's)  which  present  alphanumeric  and  visual 
information  on  any  of  a  variety  of  television-like  terminals. 

3.  Flat  panel  displays  which  present  alphanumeric  and/or  visual 
information  or.  any  of  a  variety  of  flat  panel  electronic  display 
devices. 

A  fourth  type  of  output  device  concerns  two  and  three  dimensional  output 
devices  such  as  dial  and  gauge  control,  turtles  and  robots.  Since  the 
majority  of  work  in  instruction  and  training  involves  the  first  three 
types  of  output  devices,  the  research  and  reccmrendations  presented  in 
this  chapter  concern  the  first  three  categories. 

Subdivisions  within  each  major  category  will  discuss  the  various 
types  of  electronic  output  devices  within  each  general  family. 

Comparative  evaluation  information  among  the  display  alternatives, 
if  any .  will  be  presented  and  current  and  future  trends  in  technology 
will  be  noted.  A  brief  preview  of  sene  of  the  subsection  topics  might 
be  helpful. 

The  section  on  teletypewriter  printers  will  discuss  word  processing 
printers,  computer  line  printers,  office  printers  of  various  types  and 
low  cost  printers.  Tne  types  of  printers  include  impact  printers  (which 
use  fully  formed  character^  and  dot  matrix  characters,  ink  jet  printe 
thermal  printers,  dielectric  printers  and  photographic  laser  printers. 

The  section  on  CRT  displays  will  discuss  refreshed  and  storage  CRT's, 
vector  CRT's,  raster  scan  CRT's  (television),  and  digital  TV  CRT's.  The 
section  on  flat  panel  displays  will  discuss  flat  CRT's,  light  emitting 
diodes  (LED's),  electroluminescent  film:  displays,  gas  discharge  plasm- 
panels,  1  iquid  crystal  displays  (LCD's)  and  electrociirom.ic  and  electro¬ 
phoretic  (BHD)  displays. 

Tel etypewrite r  Printers 

Teletypewriter  printers  provide  hard  copy  paper  bused  output  from  inter¬ 
active  computer  and  word  processing  systems .  Word  processing  system.- 
van  from  the  highly  sophisticated  special  i/x»d  word  processing  systems 
(e.  g.  ,  Xerox,  V.ang,  Lexitron  )  to  word  processing  packages  i  or 
main  frame  computers,  minicomputers  and  mi  crocomput  ers .  F.xce 
lent  reference  sources  Indicating  the  variety  and  cost  of 
various  word  processing  units  are  available  (Datapro ,  19m’; 
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Mandell,  1980;  Snyders,  1980).  The  prices  range  from  $100,000 
for  complete  word  processing  systems,  to  $4,000  for  word  pro¬ 
cessing  packages,  to  $20  for  single  desktop  word  processing 
programs.  Two  major  types  of  printers  are  available:  fully 
formed  character  printers  and  dot  matrix  characters.  Fully 
formed  characters  are  similar  in  quality  to  IBM  Selectric  type¬ 
writer  print.  The  speed  of  the  fully  formed  character  printers 
is  40  to  60  characters  per  second  for  the  Qume ,  Diablo  and  NEC 
and  recent  IBM  daisy  wheel  printers.  The  dot  matrix  printers 
produce  lower  quality  output  but  at  higher  speeds.  Electronic 
data  processing  printers  using  dot  matrix  output  can  print  at 
speeds  of  120-600  characters  per  second.  High  speed  line 
printers  are  available  which  will  print  900-1200  characters 
per  second,  400  to  600  lines  per  minute.  High  speed  line  print¬ 
ers  are  primarily  used  for  centralized  computer  printers. 

The  above  discussion  has  been  focused  on  impact  printers.  Other  printer 
alternatives  are  available  using  thermal,  ink  jet,  dielectric  and  photo¬ 
graphic  lasers  as  printing  devices.  Of  these  alternatives  the  laser 
printer  appears  to  offer  the  most  promise  for  non-impact  printers 
(Iverson,  1981).  Laser  printers  are  expected  to  capture  more  than  half 
of  the  market  for  non-impact  printers. 

Following  are  seme  specifications  for  recently  developed  laser  printers. 

Hewlett  Packard  has  developed  a  laser  printer  which  prints  15  pages  per 
minute  with  a  cost  of  S108.500.  Xerox  has  developed  a  laser  printer 
with  speeds  of  43  pages  per  minute  ($91,500)  and  AM  International  has 
produced  a  laser  printer  with  a  speed  of  70  pages  per  minute.  Dale 
Kutnick  indicates  that,  "By  19S3  or  1984  we'll  see  a  lot  of  (laser 
printer)  units  under  S20.000.  We’ll  even  see  seme  slower  units  (12  to 
20  pages  per  minute)  at  the  $10,000  to  $15,000  level."  (Iverson,  19$0). 

Since  the  laser  printers  are  designed  to  print  digitally  coded  computer 
characters  they  can  easily  be  linked  up  in  network  configurations  to  provide 
electronic  mail  functions. 

The  Ricoh  Company  recently  introduced  an  integrated  system  which  consists 
of  three  units:  a  word  processor,  a  30  page  per  minute  laser  printer, 
and  a  digital  image  scanner  and  processor.  Edgor  Gladstone  (1981)  notes 
that  the  Ricoh  sy.-  ?m  provides  the  capability  "to  scan  any  kind  of  document 
into  memory,"  and  transfer  the  document  or  image  across  high  speed  lines 
to  a  remote  laser  printer. 

AM  International  has  demonstrated  a  laser  scanner  printer  system  which  scans  and 
prints  documents  at  30  pages  per  minute.  The  information  is  compressed 
and  digitized  for  storage  on  a  magnetic  disk.  Tnt  stored  document  cai. 
be  transmitted  at  speeds  as.  high  as  1  megabit  per  second.  At  the  receiving 
end  the  laser  printer  prints  the  document  at  70  pages  per  minute. 

Copies  at  several  different  sites  can  be  made  concurrently.  Presently, 
the  fastest  facsimile  printer  takes  from  30  to  40  seconds  t< 
transmit  one-  page-  to  a  single  location. 

Colored  hard  copy  output  is  also  possible  through  several  alternative 
approaches.  Photographic  processes  developed  by  Dunn  Instruments,  Matrix 
instruments ,  Image  Resources  and  Polaroid  accept  RGB  video  input  i  roc  a  CKI 
screen  and  use  a  series  of  color  filters  tc»  expose  a  photographic  film 
in  accord  with  the  color  pattern  information  from,  the  RGB  signal.  The 
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phot  ographic  systems  provide  very  high  resolution,  sharp  bright 
colors,  and  ability  to  produce  35  millimeter  slides  or  8J  x  11 
inch  transparencies.  Optronics  International  has  produced  a 
laser  scanner  printer  system  in  which  the  color  image  is  digit¬ 
ized,  stored  and  produced.  The  system  is  primarily  used  for 
aerial  photography,  radiographs  and  geophysics.  Resolutions 
of  the  color  laser  printer  are  1000  to  2000  lines  per  inch  with 
a  price  tag  of  $65,000  to  $100,000.  Color  laser  copy  systems 
have  also  been  introduced  by  the  Xerox  company.  The  copier 
uses  a  laser  beam  to  write  on  a  photosensitive  drum.  The 
sensitized  parts  of  the  drum  pick  up  colored  toners  and  then 
transfer  the  colors  to  a  sheet  of  paper  or  transparency  film. 
The  color  Xerox  system  sells  for  $28,000. 

Cathode  Rav  Tube  (CRT  i 


The  cathode  ray  tube  is  the  most  common  device  for  electronic 
information  and  visual  delivery.  A  familiar  type  of  the  cathode 
ray  tube  is  the  standard  television  receiver  or  monitor.  CRT's 
can  be  divided  into  four  major  classifications  for  this  report. 

1.  Raster  refreshed  CRT’s 

2.  Vector  CRT's 

3.  Storage  CRT's 

4.  Digital  Television  CRT's 

Raster  refreshed  CRT's  are  the  common  types  of  television 
monitors  and  computer  terminals  which  require  continuous  re¬ 
freshing  of  the  visual  display  to  maintain  a  flicker  free  image. 
Raster  refreshed  CRT's  are  generally  defined  by  the  number  of 
scan  lines  per  frame  (525  scan  lines  is  the  standard  for  NTSC 
color  and  black  and  white  television,  625  scan  lines  is  the 
standard  for  European  PAL  and  SEC AM  television  systems.)  Low, 
medium  and  high  resolution  systems  are  currently  available 
for  both  monochrome  and  color  TV  systems.  Low  resolution  sys¬ 
tems  are  generally  classed  from  200  to  500-525  scan  lines. 

Medium  resolution  systems  offer  600  to  800  scan  lines  and  high 
resolution  systems  offer  800  to  1200  scan  lines. 

Vector  CRT's  use  random  vector  patterns  rather  than  a  fixed 
horizontal  scanning  pattern  to  construct  an  electronic-based 
visual  image.  Storage  CRT's,  as  the  name  indicates,  have  a 
memory  device  which  maintains  the  visual  image  on  the  screen 
without  cont inuous  refreshing  of  the  screen.  Excellent  references 
on  CRT  devices  are  Sherr  (1979),  Cakir,  Hart  and  Stewart  (1960); 
Luxenberg  and  Kuehn ,  1968,  and  Herold,  1974.  Summary  specifi¬ 
cations  for  various  CRT  devices  are  presented  in  Tables  7-1, 
adapted  from  Sherr  (1979)  and  7-2,  from  Bean  (in  press). 


Table  7-1 


COMPARISON  OF  PARAMETERS  FOR  VARIOUS  CRT  DISPLAYS 


(Sherr,  1979 

) 

Raster  CRT 
Monochrome 

Luminance 

Bandwidth 

Resolut ion 

Standard 

120-300nits 

4-lOMHz 

480  lines 

High  Resolution 

120-300nits 

10 -30MHz 

1000  lines 

Color 

Standard 

150-250nits 

5-lOMHz 

600 H  450V 

High  Resolution 

150-250nits 

22MHz 

1200H  900V 

Digital 

St  andard 

300nits 

10MHz 

512x512pix . 

High  Resolution 

300nits 

30MHz 

880x1 024pix . 

Vector  CRT 

300nits 

15MHz- 

35MHz 

1000  lines 

Storage  CRT 

Electrical 

to  150nits 

30MHz 

1400  lines 

Direct  view 

30nits 

-- 

400-800  line 

Elect  rost  at i c 

2  50~500niis 

25MHz 

Table  7-2 


SUMMARY  CHARACTERISTICS  OF  ELECTRONIC  DISPLAYS 
(Adapted  from  Bean,  in  press) 


1 

MAXIMUM 
BRIGHTNESS 
(fl  ) 


2  3  4 

AVERAGE  GRAY 

BRIGHTNESS  CONTRAST  SCALE 
(fl>  RATIO  LEYEI 


5 


COLOR 


1002-2922 


500-200C 


50:1  12 


Cclcr 


100-200 

500-2000 


32 

50 


10  R , G , B 
12  G 
(12)  G 
S  G 


Display  Size 


20-60crr. 
30 -60cm 


50-60cm 

33-48cm 


varies 

varies 

40-53cm 


varies 
s  50-63c.m 
28x3Scm 


6 

SYMBOL 

TYRE 


Faster 

Raster 

Stroke 

Stroke 

Matrix 


W 
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Table  7-2 


SUMMARY  CHARACTER  I  ST ICS 

7 

STORAGE 
(+ PRES ENT 
DISPLAY  -ABSENT) 

OF  ELECTRONIC  DISPLAYS  (CON 
8  9  10 

FLAT 

PANEL  RESOLUTION  ELEMENTS 

.  (+yes,  ELEMENTS/  PER 

-no)  INCH  DISPLAY 

XI  NEED) 
11 

DISPLAY 

SIZES 

12 

HOW  MANY 
CHAR.  PER 
FRAME  (FULL 
SCREEN)  MAY 
ee  ns?:. .rye: 

CRTs 

Raster 

- 

- 

100 

512x512  , 

5"x7", 

to  3000 

1024,1024 

to  32" 

(409c  ,4096) 

Color 

- 

- 

20 

512x512 

5 "x7 ", 

3000 

to  25" 

Vector 

- 

- 

100+ 

512x512 , 

5  "x7  " 

3000 

(4096x4096) 

Storage 

+ 

- 

80 

512x512 , 

5"  round 

3000  r 

Dicisplay 

- 

- 

55-80 

512x512 

6 .4  "x£  .4  " 

,  1920 

5  "xlO" 

13 

14 

15 

CAN  DIAGRAMS,  SCHE¬ 

OPERATING  CONDITIONS 

MATICS  OR  PICTORIAL 

BEST  AMBIENT 

BEST  WORST 

DISPLAY 

DATA  BE  PRESENTED? 

ILLUMINATION? 

FEATUP-ES?  FEATURES? 

CRTs 

Raster 

+  yes-video  image 

-  low-mid 

CRT's  have  CRT's  are 

high  relatively 

Color 

+  yes -color  video 

-  low-mid 

resolution,  bulky,  less  - 

image 

brightness  ,  portable , 

low  cost ,  require  high 

Vector 

+  yes-high  resolu¬ 

color  voltage , 

tion 

have  screen 

curvature 

Storage 

+  yes 

Digi splay 

+  ye  s 

These  tables  she*,  that  the  luminance  for  CRT's  is  generally  from  120  to  300 
nits  (cd/rr^).  The  video  bandwidth  for  standard  raster  CRT's  is  froi.i  4  to  10 
MHz  while  high  resolution  requires  a  bandwidth  of  10  to  30  MHz.  Vector  and 
storage  CRT's  also  require  a  bandwidth  of  15-30  MHz.  Higher  bandwidths  arc 
needed  for  farter  character  and  scam  ir.tr  of  inforrmt  tor. .  The  resolution  o' 
standard  CRT's  is  between  480  and  600  lines  whale  h i gh  resolution  CRT  sy.-ttrv- 
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range  freer.  900  to  1000  lines.  Bean  not os  that  ell  •-{•lays  of  -VVX  x  4096 
pixels  are  possible.  Contrast  ratios  for  OKI's  are  fr  ee  32  to  1  to  50 
to  1.  Between  three  and  four  thousand  characters  are  ices:  Lie  per  frame 
on  some  CRT  displays. 

A  review  of  recent  electronic  journals  yielded  the  foil owing  Table  7-3 
of  high  resolution  capabilities. 


table  7-3 


COMPARISON  OF  HI 


RESOLUTION  MONIlfjR  CAPABI!  HIES 


Company  Pixels 


Aydin 

1024 

X 

1024 

Conrae 

1280 

X 

1024 

Gen i sco 

Hitachi 

1280 

X 

960 

DEC 

1024 

X 

1024 

Lex i data 

1280 

X 

1024 

Magetek 

1024 

X 

1024 

Magetek 

12  SO 

X 

12SC 

Magetek 

4096 

X 

4096 

Sanders 

1024 

X 

1024 

Tektronix 

4096 

X 

3120 

Hewlett  Packard 

1000 

X 

1000 

Cnr  erratics 

512 

X 

512 

Ramtek 

1024 

X 

1024 

Chromatics 

1024 

X 

1024 

Amperex 

1500 

scan  lines 

Classif icat ion  of  CRT  Terminals 


CRT  devices  can  also  be  classified  in  terms  of  the  processing 
and  graphic  capabilities  of  the  CRT.  This  section  will  follow 
the  classification  of  non-intel 1 igent  terminals,  smart  termina 
intelligent  terminals,  stand  alone  systems,  and  graphic  term¬ 
inals.  The  capabilities  of  each  terminal  are  discussed  by 
Warren  (1980;.  Non- i  nt  el  1  i  gent  terminals  arc-  serial  input  CRT 
or  teletypewriter  replacements.  The  terminals  include  a  key¬ 
board  and  CRT  screen  but  no  microprocessors  or  local  memory  i 
provided.  Smart  terminals  provide  vendor  rather  than  user 
programmability,  editing  and  screen  function  keys,  small  local 
memory,  and  costs  oi  between  $400  and  $3,000.  Intelligent 
terminals  include  CPU's  from.  8  bits  to  32  bits,  user  proprar- 
mability,  sophisticated  operating  system.-,  and  high  level 
language  capability,  larger  local  memory  up  to  10k  bytes  or 
more,  supporting  peripherals  without  reliance-  on  the  host  com¬ 
puter,  and  prices  from  $1,000  to  several  thousand  dollars. 
Stand  alone  systems  provide  all  el  the-  capabi  1  i t  les  of  intel¬ 
ligent  terminals  but  nave  stand  alone  processing  ,  storage . 
and  input  devices  in  addition  to  t  e>.t  display.-. 
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Television  Standards 

This  section  discusses  the  three  current  worldwide  standards  for 
television  systans.  Following  sections  discuss  future  technological 
developments  in  digital  television  and  high  definition  (resolution)  tele¬ 
vision. 

Three  major  worldwide  standards  are  employed  in  television  systems.  The  U.S. 
follows  the  National  Television  System  Conmittee  Standard  of  525  scan  lines, 

2:1  interlace  ratio  with  30Hz  per  visual  frame  and  60Hz  for  each  visual 
field  (half  a  frame).  A  composite  video  signal  is  employed  to  cod 
for  the  luminance  (brightness)  component  and  the  chrominance 
(color  hue  and  saturation)  component.  The  luminance  component 
is  formed  by  specified  proportions  of  the  red  (R),  green  (G), 
and  blue  (B)  signals.  The  chrominance  component  uses  a  set  of 
color  differences  (P.-Y,  G-Y,  and  B-Y  where  Y  is  the  luminance 
component  calculated  above). 

The  Phase  Alternation  Line  (PAL)  system  used  in  the  United  Kingdom 
Europe  and  Brazil  employs  625  scan  line,  2:1  interlace  ratio  with 
50Hz  per  frame.  The  phase  of  the  color  signal  R-Y ,  is  reversed 
180  degrees  on  alternating  lines,  leading  to  the  name  phase 
alternation  line  system.  The  SECAM  system  is  used  by  France  and 
Russia.  The  SECAM  is  a  625  scan  line  system  2:1  interlace  ratio 
50Hz  per  field. 

Table  7-4  presents  the  major  comparison  information  for  these 
three  television  systems. 


Table  7-4 

COMPARISON  OF  TELEVISION  SIGNAL  STANDARDS 


NTSC 

PAL 

SECAM 

Field  Rate 

60 

50 

50 

TV  Lines 

525 

625 

625 

Video  Band¬ 
width  (MHz; 

4.2 

5. 0-5.5 

6.0 

Sound  Band¬ 
width  (MHz 

4.5 

5 .0-5.6 

6 . 5 

Interlace 

2.] 

2:1 

2:1 

Rat i c  ■ 


This  table  highlights  that  standard  television  systems  have  525  or  62. 
scan  linos  and  require  a  video  bandwidth  of  4  to  GMiz  for  transmission 
and  recent  ion. .  For  additional  information  on  television  specifications 
the  reach  r  is  referred  to  the  following  references:  Pritchard  and  G ; :  .-vr . 
1980;  Fink,  1955;  Herbst re i t  and  Pou 1 icuen ,  1967;  and  Roiz<r,  1967. 
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Pipit  a  l_Tel  (.-vision 

Standard  television  signals  arc  electronic  signals  coding  for  a  real  visual 
scene.  Digital  television  converts  the  analog  signals  to  digital  signals 
at  the  television  camera  level.  The  digital  signals  are  processed  at  the 
television  transmission  station.  Digital  signals  are  received  at  the  receiver 
or  monitor  and  converted  from  digital  to  analog  signals  for  viewing  of  the 
visual  scene. 

Digital  TV  has  several  major  advantages.  Tne  digital  signal  is  much  more 
robust  than  the  analog  signal.  Digital  signals  can  be  recorded  and  rere¬ 
corded  multiple  times  and  still  retain  their  full  character  quality.  Digital 
signals  offer  the  possibility  of  worldwide  standardisation  of  television 
standards,  digital  signals  provide  for  higher  resolution  levels 
at  camera,  transmission,  and  receiving  units,  and  digital  TV 
provides  the  possibility  of  high  quality  large  screen  displays. 


Digital  TV  Components 

Recent  developments  in  television  electronics  have  provided  for  the  use 
of  complete  digital  systems  for  television  transmission  and  reception. 

Numerous  digital  TV  cameras  have  been  developed  (Nagirro ,  Asa i da  and  Ochi, 

1980;  Miyaji,  Morita  and  Nishizawa.  I960).  Digital 

video  recorders  have  been  developed  (.Morizondo.  Yoshida  and  Hoshimoto. 

1980.  Diermann,  1978;  Baldwin.  1978,  N'asse.  1980;  Yokayama,  Nakagawa  and 
Kalayma,  1980;  Moore,  1978;  Raigner  and  Ratleff,  1979).  Digital  to  analog 
converters  are  available  (Kester.  1979;  N'asataka.  Harada,  Uehara,  1979; 

Bucklen,  1980  and  Webster,  I960).  Digital  television  coding  and  transmission 
systems  have  been  developed  (Brown.  O'Brien,  Sawchub,  Storey  and  Marsh. 

1980;  Connor,  1980;  Ishiguro.  Tonozawa  and  Mane,  1980;  Raigner  and  Ratleff. 

1979;  Burkies, and  Wade.  1980;  Forster  and  Sochor,  1980).  Digital  transmission 
using  fiber  optics  has  been  demonstrated  (Goldberg,  Jachnowyeg  and  Rossi . 

1979;  Maney  ,  1980;  Rozien.  1980;  Connor.  1980;  Potter,  1980;  and  Proceedings 
of  IEEE,  1.980).  Digital  television  systems  have  been  discussed  and  demonstrated 
(Sherr,  1979;  Anderson,  1979;  Anderson,  1980;  Ishiguro,  Tomozawa  and  Mune, 

1980;  Limb  and  Bowen,  1980;  Raigner  and  Ratleff,  1980;  Ffozien,  1980;. 

The  above  developments  provide  for  all-digital  TV  implementation  within 
the  next  5-10  years.  Major  TV  broadcasting  studios  will  steadily  convert 
their  analog  equipment  to  digital  equipment .  In  the  interim  period  the  studios 
will  be  using  a  combination  of  analog  and  digital  equipment. 

Digital  TV  Requirements 

Digital  TV  requires  higher  bandwidth  and' bit  transmission  rates 
than  standard  analog  TV  systems.  See  Table  7-o. 
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Table  7-5 

LINE  AND  BANDWIDTH  STANDARDS 


Line  Rate 

525 

951 

1225 

1351 

1601 

Bandwidth 

NTSC  MHz 

4.2 

15 

20 

28 

40 

PAL  MHz 

5.5 

22 

30 

42 

60 

Isozaki  (197S)  Indicates  need  for  30MHz  fora  1600  line  system.  Burkhard 
and  Wasser  (19S0)  indicate  22MHz  for  34Mbit /s  digital  transmission  rate. 
pink  (19S0  a,  b.  c,  recommends  25  MHz  bandwidth  for  digital  TV  systems 
of  the  future  with  1100  scan  line  rate.  Forster  and  Sochor  (1980)  recom¬ 
mend  50MHz  for  digital  recording  systems  at  SOMuits 'second  recording  rates. 

All  references  above  indicate  the  need  for  increases  in  the  standard 
television  bandwidth  spectrum.  As  the  expected  line  rate  increases  so 
does  the  necessary  bandwidth.  Bandwidths  of  15  to  30  MHz  are  needed  for 
television  scan  line  resolutions  of  900  to  1225  scan  lines.  Bandwidths 
of  20  to  60MHz  are  necessary  for  line  rates  of  1350  to  1600  lines. 

Transmission  ana  recording  bit  rates  need  to  be  increased  for  digital 
television.  Transmission  bit  rates  of  80  to  114M  bits/second  are  needed 
for  full  digital  transmission  (Burkhardt  and  Wasser.  1980.  Connor,  I960. 

Ragr.er  and  Ratleff,  1980,  Forester  and  Sochor,  1980). 

Digital  recording  bit  rates  of  80  to  160  Mbits/second  are  needed  for  full 
digital  recording  depending  on  the  tape  size  and  speed  (Nasse,  1980:  Burkhardt 
and  Wasser,  1980;  Yokoyama,  Nakagawa  and  Kalavma,  1980).  Bit  rate  reduction 
schemes  can  be  used  to  lower  the  overall  digital  transmission  and  recording 
rates.  Inter frame  coding  schemes  can  reduce  the  required  bit  rate  to  one- 
third  of  the  full  bit  rate  ( 20- 35Mb its/ sec. )  (Limb  and  Bowen,  1980:  Nasse . 

1980;  Ishiguro.  Tcmozawa  and  Mune,  1980;  Raigner  and  Ratleff,  1979).  Picture 
Description  Instructions  can  greatly  reduce  the  transmission  rate  (Brown. 

O'Brien, Sawc huk ,  Storey,  and  March,  1980). 

Hidi  Definition  Television 

The  Society  of  Motion  Picture  and  Television  Engineers  (SMPTE)  has  formed 

an  ongoing  study  group  to  outline  the  potential  technologies  for  high 

definition  television.  The  following  are  the  major  recommendations  fra: 

the  group  of  14  major  TV  engineers  headed  by  Donald  C-.  Fink  who  played  an 

important  role  in  the  two  NTSC  committees  which  develoned  the  l.S.  televisio 

standards.  Donald  Fink  provides  the  following  major  recommendations.  (Fink,  IDSo  - 

1.  The  approximate  line  rate  for  High  Definition  T\  (Hj.\ 
is  1100  lines  per  frame,  with  1500  lines  per  frame  as 
a  future  objective. 

2.  Tne  frame  rate  should  be  30  per  second,  interlaced  two  to 
on-'  for  all  appl icat ions ,  except  the  production  of  motion 
picture  relc-ase  prints,  for  which  the  rate  should  be  24  :cr 
sec  nd  without  interlacing  (progressive  scanning),  with 
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standards  conversion  to  interlaced  scanning  introduced 
for  direct  observation  during  production. 

3.  The  aspect  ratio  should  be  not  less  than  5:3  and  preferably 

2:1. 

4.  The  technique  of  employing  a  chrominance  subcarrier  located 
within  the  luminance  band  should  not  be  used. 

5.  Separate  transmission  or  time  division  multiplexing  should  be 
used  for  the  transmission  of  chrominance  information. 

6.  The  luminance  bandwidth  (for  an  1100  line-per-frame  raster) 
should  be  approximately  25MHz,  the  precise  value  depe-ndmg 
on  the  aspect  ratio  and  horizontal  retrace  time. 

"One  of  the  major  premises  of  the  study  was  that  any  HL-’iV  must  be  capable, 
after  suitable  standards  conversion,  of  being  received  on  domestic  color 
television  receivers  of  current  design  (i.e..  those  served  by  NTSC,  PAL. 
or  SECAM  transmissions)  and  that  the  quality  of  reception  must  not  be 
inferior  to  that  inherent  in  the  design  of  the  receivers.  .Also  a  large 
screen,  wide  aspect  ratio  (5:3  or  2:1)  was  needed.  A  home  screen  display 
2m  x  lm  (80  inches  x  40  inches)  is  a  topical  objective",  (Fink,  1980;. 

Present  HDTV  systemsmay  require  higher  line  rate  and  higher 
luminance  and  chrominance  bandwidth  than  the  NTSC  standards.  The 
aspect  ratio  must  be  higher  than  the  NTSC  standard  of  4:3  and 
the  viewing  distance  needs  to  be  less  (2.5  times  picture  height) 
than  the  corresponding  NTSC  value  (about  four  or  five  times  the 
picture  height).  Most  importantly,  the  method  of  cnrommance 
multiplexing  must  employ  methods  different  freer.,  and  having  greater 
effective  bandwidth  than,  those  of  the  NTSC  system.  Standards 
conversion  from  HDTV  to  NTSC,  PAL,  and  SECAM  systems  is 
possible . 

Teletext  and  Viewdata 


Teletext  and  Viewdata  are  electronic  comm  l  cat  ion  methods  whereby  text  and 
graphics  are  either  broadcast  in  unused  television  scan  lines  (Teletext)  or  arc 
transmitted  over  telephone-  lines  using  modem  connections  (Viewdata 
(J.  Jackson.  1980 :  Clarke  ,1980.  Crowther.  1950;  Chambers,  1980,  Hedger. 

Raggett  and  Worburton,  1980.  Brown,  O'Brien.  Sauchuk,  Storey  and  March. 

1950 ;Clarke  ,1980) .  The  Teletext  system,  digitizes  magazines  through  unused 
television  scan  lines.  The-  scar,  lines  used  are  outside  the  picture-  an..:, 
and  remain  unseen  by  the  viewer.  With  a  special  teletext  decoder  the-  d:c.- 
tized  pages  can  be  converted  to  analog  signals  and  displayed  on  the  teL-vis:  n 
receiver.  The  magazines  are  broadcast  in  continuous  fashion  and  can  b-. 
modified,  updated  and  rebroadcast  at  the  television  station.  The  perse 
subscribing  to  a  teletext  system,  could  have  ready  access  to  up  to  8  ind- 
dent  mazarines  of  up  to  320.000  tele  text  pages  of  24  lin'-s  of  40  ehara  u  r- 
of  information.  Four  pages  of  teletext  can  be  transmitted  each  second. 

Although  the  capabilities  art-  very  high  as  noted  above,  gent  rally  a  in- 

of  teletext  will  consist  of  109  pages  and  requires  24  seconds  for  each 
complete  cycle  from,  page  1  to  page  10C'.  Using  the  decoder  the  view-,  r  o  f... 
alsr.  request  continuous  access  to  specified  pg‘-s  or  lories  of  inter-, 

(e.g.  continuous  record  of  L'.£.  stock  exchang-:  prices P  Tt  let  ext  c  ar.  I* 


presented  in  up  to  seven  different  colors.  Simplified  graphics 
capabilities  are  provided  through  a  2x3  dot  matrix  for  each  char¬ 
acter.  This  provides  an  80  x  72  pixel  grid  for  graphics,  diagrams, 
bar  charts  and  maps.  The  teletext  decoders  require  lour  LSI 
circuits  and  two  memory  chips. 

Viewdata  is  similar  to  Teletext  except  that  it  is  transferred  over 
telephone  lines  and  it  is  interactive.  Viewdata  provides  a  much 
wider  access  to  data  base  information  and  more  user  options  lor 
selection  of  information.  Using  Viewdata  the  viewer  transmits 
a  request  for  information  to  a  central  computer  or  data  base. 

The  request  signals  are  sent  at  75  bits/second  over  telephone- 
lines  using  modems.  The  viewer  keys  in  the  requested  page(s)  of 
information  and  the  page(s)  is  sent  to  the  receiver  at  1200  bits 
second.  Using  Viewdata  a  full  page  of  960  characters  is  trans¬ 
mitted  in  eight  seconds.  Interactive  work  with  the  computer  car. 
be  either  through  the  use  of  tree  structured  menus  or  full  key¬ 
board  selection  of  information  topics.  With  the  use  of  voice 
recognition  systems  available  in  the  near  future,  the  request 
for  viewdata  could  be  made  in  English.  Viewdata  can  be  used  lor 
information  search  and  retrieval,  computer-assisted  learning, 
vocational  training,  self  assessment  programs,  interactive  educa¬ 
tional  programs,  learning  games  and  simulations  and  for  data 
base  management  and  reporting.  Hedger,  Raggett  and  Worbuton, 

(1980)  discuss  the  potential  capabilities  of  value  added  tele¬ 
text  for  the  distribution  of  interactive  computer  programs  and 
educational  programs  using  the  various  software.  The  Teletext  or 
Viewdata  receivers  will  likely  become  standard  equipment  on  new 
television  receivers. 

Future  Advances  in  Teletext  and  Viewdata 

Philips  Research  Laboratories  have  made  experimental  Viewdata 
terminals  that  store  up  to  four  pages  in  RAM  memory,  and  a  cas¬ 
sette  recorder  that  will  store  up  to  300  Teletext  pages  on  a  60- 
minute  audio  cassette  (Jackson,  1980).  Philips  is  also  increasing 
the  character  grid  for  Teletext  and  Viewdata  systems  to  240  x  240 
pixels.  The  Tehidon  system  used  in  Canada  also  provides  for  24C 
x  320  pixels  plus  color  and  grey  scale  levels  for  each  page 
(Jackson,  1980;  Brown,  O'Brien,  Sawihuk,  Storey  and  Marsh,  1980). 

Following  is  a  list  of  the  major  international  organizations 
which  are  developing  standards  for  videotext  systems: 

European  Broadcasting  Union 
European  Economic  Community 
Internationa]  Telephone  and  Telegraph 
International  Radio  Consultative  Committee 
European  Computer  Manufacturers  Association 
European  Posts  and  Telecoms  Administration 
International  Standards  Organization 
International  Electronic  Commission 

Teletext  and  Viewdata  are  developing  dynamically  red-finable  character  sou 
(DRCS)  ( Lambert ,  BrusqJ  Mart  i  and  Poigr.-.-t  ,  1980/  and  picture  coding  instruct  ic.-.s 
(Brown,  O'Brien  Sawchuk.  Store  and  Marsh .  1930:  which  will  provide  for  in¬ 
creased  graphic  capability  and  increased  resolution  of  Teletext  and  Viewdata. 


Ishigaki.  Okada,  Hashimoto  and  Ishikawa  (1980)  discuss  several  possible 
improvements  in  television  design  for  better  teletext  reception. 

Picture  in  a  Picture  TV 


Multipicture  TV  sets  and  adjustable  screen  size  TV's  have  been  developed. 
Toshiba  has  developed  a  MultiWide  system  which  provides  for  the  display  of 
one  to  four  pictures  at  the  same  time.  Sharp  has  developed  a 
Multivision  screen  that  permits  simultaneous  display  of  two  to 
nine  pictures.  See  Figure  7-1.  Sanyo  has  developed  an  adjust  a 
screen  size  television  that  permits  three  adjustments  of  screen 
size.  Hewlett  Packard  has  prepared  a  four  window  classif icat io 
data  display  terminals.  This  system  provides  for  division  of  t 
display  memory  and  display  screen  into  four  independent  window 
work  area  spaces. 


Multmviun  lele'ision  iel  (Sharp 

Corp.. 


Hitachi  has  developed  a  fully  digitalized  color  picture  within  a  picture 
television  system  presented  in  Figure  7-2. 


Picture  *n  PiC’.j'e  Tv  (Hitachi ) 


For  additional  information  or.  nultirictuiv  TV  displays  see  Masuda.  Kuroueic: 
Imalde ,  and  Xaboya.r.a  (1979),  Purkhardi  ana  Passer  US&O),  anu 
Allrich  and  Hegendorfer  (1977). 


Flat  Panel  Devices 


In  the  past  decade  there  has  been  considerable  research  and  develop¬ 
ment  work  on  solid  state  flat  panel  electronic  displays.  The  flat  panel 
displays  offer  scalier  size,  wore  ruggedness,  lower  power  consump¬ 
tion  and  as  high  or  higher  resolution  than  previous  CRT  electronic 
displays.  Costs  of  the  flat  panel  devices  are  also  dropping  anc' 
will  continue  to  do  so  for  several  years.  This  chapter  will  out¬ 
line  the  various  flat  panel  technologies  and  the  general  comparative 
findings  across  flat  panel  devices. 

Tne  major  types  of  flat  panel  devices  include  flat  CRT's  (Digisplay),  light 
emitting  diodes  (LED's),  electroluminescent  (EL)  displays,  gas  discharge 
plasma  panels,  liquid  crystal  (LC)  displays,  electrolytic  liauids,  electro- 
chromic  displays,  and  electropharet ic  (EPID)  displays.  Excellent 
references  for  flatpanel  technologies  are  Sherr  (1979)  and  Snyder  (1 

Flat  panel  CRT’s  can  replicate  regular  CRT  displays  but  are  only  5-7  cm.  in 
depth  as  constrasted  with  regular  CRT  depth. 

Lighi.  emitting  diodes  are  used  as  small  alphanumeric  display  devices  for 
hand  calculators,  watches,  and  electronic  displays.  LED’s  are  commercially 
available  in  four  colors:  red,  orange,  yellow  and  green.  Sherr  (1979)  and 
Snyder  (1980)  note  that  LED's  are  useful  for  single  and  multiple  alphanumeric 
displays  but  due  to  the  high  power  consumption,  large  matrix  and 
large  screen  displays  will  require  future  technologies. 

Electroluminescence  displays  consist  of  a  thin  film  layer  of  zinc  sulfide, 
phosphors  and  copper  (cu)  or  maganese  (Mn)  activators  which  is  placed  in  a 
dielectric  medium,  between  two  electrodes  carrying  either  AC  or  DC  current 
of  30-650  volts.  The  application  of  voltage  leads  to  emission  of  light 
energy  which  can  be  modulated.  Matsushita  Electric,  Sharp  Electronics 
and  Y.'estinghouse  all  have  demonstrated  the  use  of  electroluminescent  devices 
to  present  a  monochrome  commercial  TV  program.  Electroluminescent  displays 
have  good  luminance  and  gray  scale,  size,  and  high  element  densities 
(Snyder.  1980.  Kazan,  1976).  Allen  (1980)  notes  that  "of  all  the  display 
technologies  competing  for  application  in  large  flat  panels,  none 
looks  more  promising  than  ac  thin  film  electroluminescent  tech- 
nologv . "  Elliot  Schlam  (1980),  notes  that  ac  thin  film  electro¬ 
luminescent  film  shows  the  greatest  promise  for  meeting  the 
Army’s  tactical  display  requirements. 

"Over  the  past  12  years,  we've  evaluated  LED.  LCD.  plasmapanel.  electrochronic, 
electrophoretic ,  and  CRT  displavs.  and  evidence  points  to  the  conclusion  that 
th in-film  technology  has  the  best  future  potential  for  the  preponderance  cf 

our  military  panel  objectives  of  highly  mobile  rammed  displays.' ' 


Plasma  or  pas  discharge  displays  are  based  on  the  same  chemical  principles  a.- 
the  NIXIE  numeric  indicator  lor  neon  lights  and  signs.  Plasma  pandit 
a  gas  filled  area  through  which  an  electrical  field  can  be  applied.  The 
electrical  field  causes  the  movement  of  electrons  from  a  high  energy  lew. 
to  a  low  energv  level.  Vfnen  sufficient  number  of  atoms  have  lost  at  leas: 
one  elettror. .  the  pas  ionizes  arid  emits  light.  Plasma  panels  can  be-  used  for 
large  scroc-r.  high  resolution  and  TV  video  display  devices. 


i  r,  v  o 
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The  liquid  crystal  display  is  forced  by  sandwiching  a  liquid  crystal  subst an: 
between  transparent  glass  plates.  The  application  of  voltage  causes  the 
realignment  and  movement  of  the  liquid  crystal  molecules  which  modulate*, 
the  light  reflected  from  the  liquid  crystal  substance.  IjC  displays  are 
widely  used  in  watches  and  calculators. 

New  LCD  applications  include  displays  for  marine  applications,  point- 
of-sale  terminals,  word  prc»cessors ,  hand-held  light  niters  for  photograph'., 
digital  panel  reters.  ana  medical  mst nj.m-.ni at  1  on .  lxxj\inp  on  the  hor;z«.n 
are  automotive,  avionic,  ana  agr ionic  (tractors,  farm,  implements,  ana  so 
on)  applicat  ions,  which  several  LCD  manufacturers  are  working  on  p-.-netra:  ina . 
(Allen.  1980; 

The  LC  display  has  a  very  low  power  requirement,  which  is  corn  a r  a1  le  with  the 
low  power  MGS  (metal  oxide  semiconductor)  technologies  so  that  de-vices  having 
LC  displays  could  operate  for  extremely  long  periods  on  batteries. 


Hie  electrophorectic  display  is  based  on  the  principle  of  electrophoresis: 
the  movement  of  charged  particles  in  a  liquid  base  as  the  result  of  the 
application  of  electrical  field.  The  charged  particles  are  of  a  different 
color  and  density  than  the  surrounding  liquid.  Thus  the  electrophoretic  move¬ 
ment  of  the  charged  particles  to  the  display  surface  causes  the  observer 
to  see  the  particles.  When  the  field  is  reversed,  the  particles  migrate 
away  from  the  display  surface  and  only  the  liquid  can  be  seen.  Elect rophor~-t 
principles  in  displays  was  initiated  by  Ota.  Ohnishi  and  Voshiyama  (1973). 

EPID's  have  beer,  fabricated  in  sizes  of  300  x  150mr..  with  pixel  density  of 
5  elements /nr:  and  with  color  combinations  of  black 'white,  blue; 'white .  black, 
yellow  and  red/yellow  (Snyder.  1980).  Lewis  (1976)  indicates  that  EPID 
devices  may  retain  an  image  for  several  months  after  the  electrical  field 
is  removed.  Snyder  (1980)  notes  that  because  of  the  si  a1,  response  speed 
ET'IDs  will  likely  not  be  applicable  for  dynamic  graphics  and  television 
displays. 


CHAPTER  S 


COST/BENEFITS  ANALYSIS 

f  • 

This  chapter  presents  the  method  for  estimating  costs,  then 
for  each  system  type  presents  a  full  feature  configuration 
with  options.  In  most  cases  one  or  more  lower  cost  configurations 
are  also  presented  and  the  tradeoffs  are  presented  qualitatively. 

The  costs  presented  here  are  very  rough,  and  are  intended  only 
to  provide  discussion  points.  The  AGIO  Data  Base  Correlation 
study  will  use  these  figures  and  the  reviews  of  them  to  develop 
more  definitive  projections. 


Cost  Methodology 

The  following  steps  were  necessary  to  cost  the  system  types: 

1.  Identification  of  essential  system  components.  This  step 
was  necessary  because  over  the  forecasting  horizon  the  cost  of 
each  component  will  behave  differently.  Certain  components  are 
mature  products  and  will  remain  constant  in  price  or  experience 
only  moderate  price  decreases  in  real  dollars.  Other  products 
are  in  the  ''take-off"  stage  and  will  experience  sharp  price 
decreases . 

2 .  Determination  of  present  shipments  and  estimated  future 
shipments  of  each  component.  Most  of  these  figures  are  estimates 
by  industry  experts  and  market  research  bodies  (e.g.,  Data  Pro',. 
This  is  the  primary  factor  in  determining  the  magnitude  of 

the  cost  decreases. 

3.  Position  components  on  life  cycle  curve.  This  is  a 
qualitative  procedure  that  aids  in  the  assessment  of  costs. 
Generally,  as  cumulative  shipments  double,  the  price  falls 
20  to  30  percent. 

4.  Determination  of  current  costs.  This  was  accomplished  by 
obtaining  price  lists  from  manufacturers  and  distributors  and 
interviewing  marketing  and  engineering  personnel.  Since  most 
sales  transactions  involve  substantially  fewer  quantities  than 
Army  t ransact ions ,  estimates  were  made  of  costs  in  terms  of 
5000  quantity  transactions.  Table  8-1  presents  this  data. 

5  .  Determinate  on  of  op  t  imistic  and  pessi  mistic  cost  project  ion.-  . 
Steps  2  and  3  led  to  a  determination  of  estimates  of  the  percent 
decrease  in  cost  per  year  for  each  component.  Sometimes  twe 
estimates  of  cost  decreases  were  determined  to  indicate  a 
probable  range  within  which  the  true  value  would  be  expected 
to  fall.  One  estimate  represents  a  pessimistic  or  small  per¬ 
centage  decrease  ir.  cost  per  year;  the  second  estimate 
represents  an  optimistic  or  large  percentage-  decrease  . 
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These  percentages  were  applied  to  the  current  cost  estimates 
in  step  4  to  project  expected  or  pess  irr.i  st  ic  and  optimistic 
future  costs  for  1985.  If  a  component  h  .d  exhibited  relatively 
stable  price  decreases  historical ’ v ,  then  only  one  "expected" 
value  was  projected.  In  these  cases  this  value  was  used  as 
the  expected  future  cost.  In  other  cases,  averages  or  the 
optimistic  or  pessimistic  figure  was  selected  depending  upon 
the  judgement  of  industry  experts.  Table  8-1  presents  this 
informat  ion . 

These  component  costs  were  simply  added  together  as  they  were 
configured  into  a  system  type.  This  figure  was  then  adjusted 
up  20  percent  to  account  for  integration,  checkout,  delivery, 
etc. 


* 

» 

» 
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Pro s c-nt  at  i on  of  C ompor.en t_  Costs 

The  current  and  projected  component  costs  are  presented  in 
Table  S-l.  The  first  column  lists  the  estimated  current  costs 
for  quantity  5000.  The  last  column  lists  the  equivalent  future 
costs.  The  column  entitled  "Other"  contains  percent  decreases 
per  year  of  those  components  that  are  expected  to  have  cost 
decreases  other  than  the  1-251  range.  The  costs  corresponding 
to  these  percent  decrease  per  year  are  found  in  the  last  column. 
The  other  columns  contain  cost  estimates  associated  with  each 
percent  decrease  per  year  value. 

Each  row  will  have  one  or  two  elements  in  addition  to  the  first 
and  last  column  elements.  If  only  one  element  is  filled  in,  it 
value  represents  the  expected  future  cost  of  that  component .  I 
two  values  appear,  they  represent  pessimistic  and  optimistic  cost 
projections.  The  pessimistic  projection  always  appears  to  the 
left  of  the  optimistic  projection.  As  mentioned  earlier,  the 
projected  cost  may  be  one  of  the  values  entered  on  that  row  or 
an  average  of  the  values.  The  projected  prices  are  1981  dollars. 
They  would  have  to  be  adjusted  for  general  inflation. 


Assumptions  of  Projected  Component  Costs 

The  following  pages  contain  an  economic  and  market  description 
of  a  few  of  the  major  components  for  which  commercial  information 
is  available.  These  descriptions  form  the  basis  of  the  assumrtio 
made  explicit  in  the  component  cost  table. 


I_nru t _ T i_ c  e 

Kev boards  and  keypad.1-  .  Keyboards  and  keypads  are 
products.  kill  ions  oi  keyboards  and  ke  ypads  have 
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manufactured  and  millions  more  will  be  produced  over  the  next 
several  years.  Since  keyboards  and  keypads  contain  many 
mechanical  parts,  their  price  is  expected  to  decrease  only 
moderately  over  the  next  few  years. 

There  are  many  different  styles  and  sizes  of  keypads.  A 
typical  keypad  has  12  to  16  keys  and  costs  as  little  as 
17  dollars. 

Keyboards  are  more  standardized  than  keypads  and  typically 
resemble  the  standard  typewriter  keyboard.  Keyboards  can 
be  purchase  in  large  quantities  for  less  than  one  hundred 
dollars . 


Touch-panel s .  In  contrast,  touch  panels  represent  a 
relatively  new  product.  As  new  applications  are  discovered 
the  quantity  of  touch  panels  produced  will  increase  manyfold. 
Since  touch  panels  are  primarily  electronic,  their  cost  is 
expected  to  decrease  substantially  by  19S5. 

Speech  input .  These  devices  vary  widely  in  quality  and  cost. 

We  feel  that  only  the  best  of  the  current  speaker  dependent, 
isolated  or  connected  word  technology  is  sufficiently  accurate 
for  widespread  use  in  the  Army.  Price  of  this  type  of  high 
quality  system  is  currently  about  S8000,  but  can  be  expected 
to  fall  rapidly  by  19S5. 

Graphics  tablets.  There  is  unanimous  support  among  experts 
contacted  for  the  appropriateness  of  the  data  tablet  for 
transferring  linedrawings  into  digital  format.  One  expert 
said  this  manual  transfer  is  not  cost  effective,  and  recommends 
a  solid  state  camera  manufactured  by  Data  Copy  of  Palo  Alto. 

This  expert  claims  that  data  tablets  are  so  labor  intensive 
that  one  client  does  all  their  digitizing  in  India  because 
of  cheap  labor  costs. 

Data  tablets  are  made  by  Summagraph i cs ,  HP,  GTCO,  and  other 
manufacturers.  They  come  with  different  sizes,  resolution, 
and  features.  Most  display  system  houses  will  sell  the  tablet 
as  an  option  for  about  $2,000.  The  interfacing  may  be  standard 
or  may  require  a  board  that  costs  another  $1,500  to  $4,000. 

(Some  interface  boards  are  equipped  with  their  own  microprocessor 
and  handle  four  or  more  input  devices.'1  GTCO  will  sell  a 
tablet  for  $600  OEM. 

Most  tablets  come  standard  with  a  stylus.  Some  come  with  ink, 
some  without.  Some  styli  have  up  to  1C  buttons.  For  about 
$200,  a  "puck"  is  available  with  cross  hairs  and  up  to  16  key.-,. 
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Joysticks  and  trackballs.  Some-  users  rc-commend  that  the-  tablets 
should  be  used  with  joysticks  and  some  say  definitely  not. 
Joysticks  cost  up  to  an  additional  $1000,  but  have  less  inter¬ 
facing  requirer  ?nts  than  data  tablets.  Joysticks  are  used 
primarily  for  :dentifying  points  on  a  matrix  and  for  rotating, 
panning,  and  cursor  control. 

None  of  the  industry  experts  questioned  recommended  a  trackball. 
Some  houses  offer  trackballs  as  options.  Most  experts  said 
trackballs  were  not  very  popular.  High  quality  trackballs  cost 
between  S500  and  $1,500.  Trackballs  are  used  for  continuous 
tracking  applications  (e.g.,  air  traffic  control  or  radar). 

Use  of  light  pens  was  discouraged  by  industry  experts  consulted. 
Where  used  currently,  the  use  is  primarily  for  menu  selection. 

Some  houses  offer  a  special  function  keypad,  and  some  offer 
special  function  keys  on  their  keyboard,  which  are  user 
definable. 

Mouse  input  devices.  A  mouse  is  rolled  over  a  flat  surface, 
and  senses  position  by  noting  the  revolution  of  its  wheels. 

If  it  is  picked  up,  it  loses  its  place.  Thus  it  tracks  relative 
position,  rather  than  absolute  position  as  on  a  data  tablet.  The 
mouse  can  thus  be  relatively  inexpensive.  Since  it  is  largely 
a  mechanical  device,  its  price  is  not  expected  to  fall  by  much 
in  the  future. 

Valuators .  A  valuator  is  a  device  like  a  "game  paddle"  or 
rheostat  on  a  personal  computer.  As  a  knob  is  twisted  the 
valuator  sends  corresponding  signals  to  the  computer.  This 
device  is  quite  simple,  in  high  volume  production,  and  largely 
mechanical.  It  is  thus  relatively  inexpensive  and  stable  in 
price . 


Processing  Devices 


The  computer  industry  and  processors.  The  computer  industry 
is  fast  becoming  the  world's  largest  industry.  With  industry 
revenues  around  $50  billion,  it  has  nearly  doubled  since  1975. 
The  industry  is  characterized  by  innovation  and  technological 
changes.  As  component  prices  decrease,  more  and  more  appli¬ 
cations  become  economically  feasible. 

One  of  the  fastest  growing  sectors  of  the  industry  is  the  small 
computer  business  system.  The  technology  is  changing  so  fas*, 
that  it  is  hard  to  define  a  "small"  system.  A  small  business 
system  implies  that  most  of  the-  processing  takes  place  on  a 
thin  board  about  the  size  of  a  notepad.  Most  of  the  systems 
have  a  16  bit  processor,  metal  oxide  semi  conduct  or  (MOS) 
random,  access  memory  (RAM;,  floppy  or  Winchester  disks,  a 
serial  or  line-  printer,  and  at  least  one  terminal.  An  economic 
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overview  of  the  small  business  system  is  appropriate  for  this 
project  because  the  present-tion  features  take  advantage  of 
small  computer  system  processing  and  storage  technology. 

In  I960  approximat ely  60,000  small  business  systems  were  shipeed 
at  an  average  value  of  $60,000.  This  volume  is  expected  to  reach 
500,000  units  by  1985  and  3,000,000  units  at  the  close  of  the  mcai 

The  average  cost  per  system  is  expected  to  drop  to  $25,000  by  19*,$ 
and  S 1 5 , 000  by  1990.  This  downward  sloping  cost  trend  is  a  nece.-s.- 
condition  for  the  desirable  features  to  be  economical  1 feasible. 

A  detailed  analysis  requires  that  we  break  the  system  into  its 
component  parts: 

--  CPU  and  1/0  drivers 
--  Peripherals 
--  Software 
--  Storage 

At  the  present  time  a  16  bit  Motorola  68000  CPU  chip  is  priced 
at  $200.  If  this  is  assembled  onto  a  CPU  board  with  a  6809  proces¬ 
sor.  memory  management,  serial  I/O  ports,  parallel  ports,  floppy 
disk  interface,  and  a  RAM  card, the  cost  rises  to  about  $1,500. 

This  chip  uses  32  bit  words.  16  bit  data  paths  and  2-1  bit  addresses 

In  February  1S81,  Intel  Core,  detailed  some  specifications 
of  the  initial  components  of  its  32  bit  microprocessor  family. 

The  three  chip  set  which  is  called  a  micro-mainframe  uses  32  bit 
words,  data  paths,  and  registers  and  is  expected  to  be  priced  at 
less  than  SI, 500.  Intel's  432  100  single  board  computer  which 
incorporates  a  two  chip  set  sells  for  about  $2,500.  The  package 
does  not  include  the  interface  processor  chip. 

The  present  SI . 000-SI . 500  cost  differential  between  the  16  and 
32  bit  processors  is  expected  to  diminish  over  the  next  five  year.-. 

In  terms  of  the  processing  component  of  Electronic  Delivery  S'-te"-. 
there  are  three  basic  components:  (1)  the  mi croproress*  r  ok  t : 

(2 )  the  surrounding  components  which  provide  a  working  envi  r  *  r.n  •.  t  * 
(i.e..  interfacing,  ports,  fan,  power  supply,  etc  > .  and  t  h* 
assembly  labor. 

Over  the  next  several  years  .  millions  of  chips  will  be  produced 
As  a  result,  the  computing  power  will  multiply  as  t  he  cost  fall.- 
to  a  fraction  of  present  figures. 

The  surrounding  corr.iont  r. i  are  expected  to  decrease  in  cost  s  ever 
the  next  several  year-  but  ne  t  a-  drama*  :  cal  1  v  as  the  chip  c:  m:  r-  : 
This  is  because  these  component  s  are  noia  mechanical  in  natar- 
than  the  on  ip  comport '-n  i  . 

in  contrast  .  t  tie  1  ab<  -r  comp  -r.ent  should  remain  about  const  an  t  i 
real  term-  over  t  he  next  several  years.  .  Some  labor  cost  s  a  v :  n  c  - 
may  re.- ul  t  f  r<  >m  t  :,*•  trend  toward  more  s'q.hi  st  i  cat  t  d  com:  or.*  n*  - 
thn*  would  hand:*  r.uitipl*  *  a*-ks  and  d*crea-t  tin  a  -m.:  ■  t  :r  • 
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Random  access  memory  (RAM').  Internal  memory  represents  a 
fairly  substantial  cost  component  of  the  con f i gurat ion .  RAM 
is  still  experiencing  some  innovation  as  more  densely  packed 
chips  are  replacing  older  chips.  The  16K  bit  chips  (which 
displaced  the  4K  bit  chips)  have  decreased  from  $9.00  to  $2.50 
per  K  bit  in  the  last  two  years.  The  new  64K  bit  chips  are 
expected  to  be  cost  competitive  on  a  per  byte  basis  by  early 
1983.  Table  8-2  illustrates  the  tremendous  growth  of  16K 
RAM  devices. 


Table  8-2 


NTM5ER  OF  16-K  RAM  DEVICES  SHIPPED 


1975 

1976 

1977 

1978 

1979 


Less 

Less 


than  1 , 000 
than  100,000 
1.8  million 
20  million 
60  million 


Printers  and  Modems 


Some  devices  are  usually  available  from  a  central  facility 
but  are  not  required  by  every  terminal.  Printers  and  modems 
fit  this  category.  While  there  are  many  types  of  printers, 
the  applications  envisioned  here  would  make  use  of  only  two 
basic  types:  a  dot  matrix,  in-house  quality  printer  of  about 
200  characters  per  second  capacity,  and  a  letter  quality 
printer  for  word  processing  which  would  run  at  about  55 
characters  per  second.  A  number  of  innovations  are  taking 
place  in  this  field  and  quantities  are  increasing.  Therefore 
price  reductions  of  10  to  15  percent  per  year  can  be  expected 
in  printers. 

It  is  anticipated  that  until  data  networks  become  more  widespread 
(after  1985)  the  primary  means  of  realtime  data  transfer 
between  Army  training  centers  will  be  via  voice  grade  telephone 
with  modems.  The  upper  limit  for  reliable  communication  by 
voice  grade  phone  is  about  1200  Baud  (roughly  120  characters 
per  second).  Modems  are  almost  entirely  electronic,  and 
their  prices  are  falling  rapidly.  We  expect  integrated  chip 
circuits  to  be  widely  available  for  modems  by  1985,  and 
therefore  project  quite  low  prices. 


Long  Term  Memory 

Winchester  Disks.  High  density  hard  magnetic  disks  based  or. 
Winchester  technology  are  becoming  very  popular.  Today  a 
high  volume  purchase  of  30  mbyte  Winchester  disks  with 
controllers  might  cost  S1600  per  unit.  Another  S1600  would 
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need  to  be  added  for  the  tape  backup  with  controller,  and 
another  $200  would  be  required  for  the  cabin-,  t.  Moderate 
price  decreases  of  5-10  percent  can  be  expected  for  the 
disk  and  tape  as  volume  increases.  No  decreases  are  expected 
in  the  cabinet. 

A  10  mbyte  Winchester  with  tape  and  controllers  should  be 
available  in  a  small  package  for  approximately  S2300  in 
large  quantities.  This  price  can  be  expected  to  fall  by 
about  15  percent  per  year. 

Data  cards.  Data  cards  (ID  cards),  which  are  similar  to 
current  credit  cards  with  magnetic  stripes,  are  gaining  in 
information  density.  Optical  formats  are  being  prototyped 
as  well  as  magnetic  formats.  Simple  reader  writers  for  these 
high  capacity  cards  are  still  in  the  prototype  stage,  but  it 
has  been  estimated  that  in  high  volume  their  current  price 
would  be  approximately  $145,  and  that  a  15!,  annual  decrease 
can  be  expected  through  19S5. 

Floppy  disks.  Floppy  disks  are  growing  in  density  of  packing, 
and  prices  for  the  same  storage  capacity  are  falling.  Moreover, 
very  large  scale  integrated  chips  can  be  used  for  the  controllers. 
Price  decreases  of  10  to  15  percent  per  year  are  projected 
for  dual  sided  double  density  floppies  of  approximately 
2  megabyte  capacity. 

Output  Devices 


NTSC  color  TV  monitors.  Approximately  10  million  color  TV 
sets  were  sold  in  the  U.S.  in  I960.  The  sales  of  color  TV 
sets  is  expected  to  increase  to  approximately  13  million  per 
year  in  1985.  The  increase  is  due  to  both  technological  anu 
socio-economic  factors.  Cable  TV,  video-cassette  recorders, 
videodisc  player,  video  games,  home  computers,  etc.,  are 
all  making  the  color  TV  a  more  popular  product.  By  the  same 
token,  inflation  and  rising  fuel  costs  are  influencing 
consumers  to  spend  their  entertainment  dollar  on  activities 
centered  around  the  home  Tv. 

Industry  experts  do  not  anticipate  major  decreases  in  prices, 
but  at  best  only  slight  decreases  (1-5  percent  per  year)  since 
more  ar.c  more  features  will  be  incorporated  into  a  single  TV 
set.  An  industrial  tyr,e  NTSC  color  TV  monitor  sells  for  S35C 
in  larger  quantities. 

Projection  TV's.  This  is  a  new  product  that  is  gaining 
popularity  because  of  the  increasing  entertainment  time  that 
is  spent  in  the  home .  Fewer  than  300,000  projection  system- 
were  sold  in  1980.  The  annua)  figure  is  expected  to  surpns.- 
400,000  units  in  1985.  The  present  cost  of  a  durable 
industrial  /educat  ional  system,  is  approximately  53750  m 
large  quantities.  Deere  as-  s  in  price  as.  well  as  in.crea.--  - 
in  quality  art  anticipate  a  i  or  pro.m-e  t  ion  TV  syst  •.  m.-  . 
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NTSC  monochrome  monitors.  Since  90  percent  of  American 
households  have  at  least  one  color  TV  and  <10  percent  have  two 
or  more,  this  leaves  little  growth  opportunity  for  black  and 
white  TV's.  Zenith  predicts  the  penetration  rates  of  color 
to  rise  from  72  percent  in  1975  to  95  percent  of  total  U.S. 
households.  This  trend  will  prevent  the  cost  of  monochrome 
monitors  from  decreasing  much  over  the  next  five  years.  An 
industrial  monochrome  TV  can  be  purchased  for  S200  in  large 
quantities.  This  does  not  include  built-in  text  or  graphic 
capabi 1 it  y . 

Alphanumeric  terminals.  Alphanumeric  CRT’s  are  a  mature 
product  and  the  rate  of  growth  and  innovation  is  slowing. 
Shipments  of  U.S.  manufacturers  are  expected  to  reach  775,000 
units  in  19S5  from  510,000  units  in  1980.  At  the  end  of  1980 
the  total  installed  base  was  estimated  to  be  2.2  million  units. 
Most  alphanumeric  terminals  retail  from  S200-$4,500.  The  price 
of  a  CRT  is  expected  to  decrease  only  slightly  in  real  terms 
over  the  next  four  years.  For  the  applications  presented  here, 
a  combined  text  and  graphics  capability  is  generally  preferred 
over  alphanumer ics  only.  If  an  alphanumeric  CRT  is  used,  it 
would  most  likely  be  toward  the  low  end  of  the  cost/feature 
spectrum. 

Monochrome  graphic  terminals.  In  19S0,  approximately  60,000 
graphic  display  terminals  were  shipped  by  U.S.  manufacturers 
worldwide.  This  figure  is  expected  to  approach  a  quarter  of 
a  million  by  1985.  For  over  ten  years  direct  view  storage 
tube  (DVST),  a  vector  graphic  technology,  has  dominated  the 
monochrome  terminal  market.  DVST  is  a  mature  technology  and 
significant  advances  that  will  increase  performance  or  decrea.-- 
cost  are  not  anticipated.  The  Tektronix  4014  DVST  monitor  st  - 
for  approximately  S8,000  in  large  quantities.  It  has  a  resolute 
of  1024  x  1024  lines  and  is  monochromatic  (1024  x  780  within  the 
viewed  area). 

The  storage  requirements  for  this  degree  of  resolution  for  a 
raster  scan  system  have  been  too  costly  for  this  technology  to 
compete  in  the  market,  since  one  bit  is  required  for  each  pixel 
of  resolution.  Thus  over  1  million  bits  of  memory  are  required 
to  support  a  1024  x  1024  display.  However,  recent  semiconductor 
advances  are  rendering  the  bit-mapped  raster  scan  system  an 
economically  feasible  alternative.  The  Genisco  G-1000  is  a 
1024  x  1024' monochrome  (  1024  x  792  within  the  viewed  area  ' 
display  monitor  that  sells  for  $10,000  in  quantity  one.  In 
large  quantities,  the  price  would  likely  be  a  little  more  than 
half  this  amount. 

One  could  expect  to  pay  about  $2500  for  large  quantities  o:_ 
medium  resolution  monochrome  terminals  (512  x  512  or  360  x  <20.. 

A  low  resolution  monochrome  terminal  can  be  purcha.-ed  i  or 
several  hundred  dollars. 


Color  graphic  t  errr.i  na  1  s  .  Innovations  in  storage-  ar.ri  color 
printing  technology  have  sparked  the  growth  of  color  graphic 
displays.  Experts  predict  that  the  15,000  color  displays 
shipped  in  1979  will  expand  to  200,000  per  year  by  1983.  This 
growth  is  due  in  large  part  to  the  increased  cost  effectiveness 
of  raster  scan  display  monitors  which  are  easily  adaptable  to 
color . 

A  1024  x  1024  graphic  display  monitor  with  the  capability  to 
display  16  colors  is  priced  at  $18,000  (Chromatics  CGC7900 
Model  II).  The  price  drops  to  $3,000  -  $6,000  for  medium 
resolution  8  color  monitors  (480  x  3S4  -  640  x  480).  A  lov. 
resolution  color  monitor  (160  x  192)  ranges  in  cost  from, 
several  hundred  to  several  thousand  dollars. 

Flat  panels.  Flat  panels  which  display  more  than  200 
characters  at  one  time  represent  a  very  new  product.  At  the 
present  time,  none  of  the  flat  panel  technologies  are  cost 
competitive  with  CRT's  for  the  typical  desk-top  applications. 
However,  the  space  and  visual  advantages  of  flat  panel 
displays  are  inducing  manufacturers  to  develop  cost  competitive 
flat  panel  alternatives  to  the  CRT.  The  current  cost  of  a 
512  x  512  flat  panel  display  is  approximately  $4,500.  The 
militarized  version  that  is  in  compliance  with  military 
specif icat ions  can  be  purchased  for  $10,000.  The  Interstate 
Electronics  PD3000  plasma  display  flat  panel  conforms  to 
the  following  military  specifications:  MIL-STD-461 ,  MIL-STL-8I0 
and  MI L-E-5400R . 


NTSC  videodisc  players.  There  are  many  competing  formats  of 
videodisc  players.  For  the  applications  presented  here,  the 
player  must  be  able  to  refresh  a  single  frame  (e.g.,  of  text 
and  graphics)  indefinitely  and  must  include  a  microprocessor. 
Because  of  the  heavy  use  expected,  a  commerc ial / indust  rial 
player  is  required.  Currently,  such  players  using  laser 
optics  are  priced  at  about  S1600  in  large  quantities.  As 
cumulative  experience  increases,  the  price  can  be  expected 
to  fall  10  fo  20  percent  per  year  on  the  average. 

Videodisc  interface .  In  order  for  the  videodisc  to  be 
controlled  by  a  computer,  a  hardware  interface  is  needed. 

Some  videodisc  players  include  this  as  a  standard  item,  while 
for  others  it  is  an  option.  As  an  option  the  cost  today  is 
under  $ 200.  Since  this  is  electronic,  the  cost  will  likely 
fall  to  about  $100. 


NTSC 
t  ext 
This 
f  rom 
This 


and  mixer .  In  order  to  place 

a  generator  is  nece'ssar;. 
video  mixer  which  combine  s  inapt.  -~ 
the  videodisc  with  computer  generated  text  and  graphic- 
permits  ovverlays  for  generative  items,  to 


t ext  - g raphlcs  generator 
and  graphics  or.  the  TV  screen 
sestet,  mav  include  a 


student's  response,  and  to  corre-ct  errors.  The 
Instruments  T19918  chip  is  an  inexpensive  means 
those  functions  todav  .  In  a  working  env :  ronn.e  r. 
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associated  circuitry,  the  system  would  be  priced  at  approximately 
$385  in  large  quantities.  This  price  can  be  expected  to  fall 
about  10  to  20  percent  per  year  if  demand  increases. 

Voice  output .  Many  kinds  of  voice  output  are  available, 
ranging  from  relatively  low  quality  for  under  $50  to  extremely 
high  fidelity  digital  recording  systems  for  tens  of  thousands 
of  dollars.  The  system  which  most  closely  fits  the  needs  of 
Army  technical  training,  where  revision  rates  are  very  high, 
is  likely  to  be  a  fairly  straightforward  analog  to  digital 
conversion  (e.g.,  pulse  code  modulation  or  adaptive  delta 
modulation).  Other  systems  using,  for  example,  linear 
predictive  coding  yield  lower  costs,  generally  lower  fidelity, 
and  greater  difficulty  in  making  the  initial  encoding  of 
voice.  A  telephone  quality  random  access  pulse  code  modula¬ 
tion  (PCM)  voice  output  system  would  cost  approximately  $1500 
in  large  quantities  today.  Integrated  circuits  could  be  used 
to  bring  this  cost  down  to  approximately  $650  by  1985  if  the 
cumulative  experience  and  sales  burgeon  as  expected. 


Production  Devices 

Studio  quality  text /graphics  generator.  In  order  to  prepare 
high  quality  text  and  graphics  directly  for  video,  a  studio 
quality  system  is  needed  which  offers  multiple  fonts,  color, 
shading,  and  spacing.  Only  one  such  system  is  needed  for 
each  major  authoring  shop.  The  best  of  these  systems  in 
quantity  one  cost  from  $60,000  to  $70,000  today.  Small  to 
moderate  prices  decreases  are  expected,  given  the  very  small 
volume  for  these  systems. 

Three-quarter  inch  videotape  editing  equipment .  Each  authoring 
group  needs  a  videotape  player,  and  preferably  a  limited 
editing  system  in  order  to  review  tapes  during  the  authoring 
and  production  steps.  Only  one  videotape  editing  system  is 
needed  for  each  authoring  group.  A  simple  system  currently 
is  priced  at  about  $4300,  with  slight  decreases  possible 
over  the  next  four  years. 


Militarized  Components 

The  term  "militarized"  is  ill-defined.  Separate  specifications 
exist  for  vibration,  temperature,  salt  spray,  and  many  other 
factors.  What  is  intended  here  is  ruggedness  for  use  in  forward 
areas,  but  in  somewhat  protected  maintenance  situations. 
Depending  on  the  specifications  to  be  met,  militarized 
equipment  may  cost  two  to  20  times  as  much  as  commercial 
hardware.  For  our  applications,  electronic  component  cost s 
were  for  the  most  part  doubled,  though  keypads  and  keyboard 
were  increased  more  based  on  cost  histort. 
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Militarized  components  often  employ  state  of  the  art,  low- 
volume  components.  An  example  is  flat  panel  displays.  These 
can  be  expected  to  drop  rapidly  in  price  if  the  basic 
technology  is  picked  up  in  the  industrial  and  consumer  arenas. 

Magnetic  bubble  memory  is  currently  available.  As  noted  in 
the  table,  its  cost  is  expected  to  drop  about  25  percent  per 
year  through  1985. 


Hand  Held  Components 


The  hand  held  system  for  data  entry  (e.g.,  scoring  and  inventory) 
requires  battery  powered,  small  circuitry.  Its  processing  and 
display  requirements  are  limited.  Except  for  the  power  supply 
and  keypad,  component  prices  are  likely  to  come  down  rapidly 
as  volume  increases. 

Costing  Assumptions 


Now  that  component  costs  have  been  identified,  they  can  be  combine  c 
with  the  benefits  of  the  presentation  features, and  alternative 
configurations  can  be  analyzed  in  light  of  the  Army’s  training 
requ i rement  s . 

The  five  system  types,  which  are  adaptable  to  all  of  the  scenario- 
analyzed  in  this  and  previous  studies,  are  analyzed  individually. 
First,  a  recommended  configuration  is  defined  for  the  particular 
system  type.  Then  the  recommended  configuration  is  defended  based 
on  the  cost /benefit  trade-offs.  In  addition  a  lower  cost  alterna¬ 
tive  is  configured.  Finally,  the  add-on  options  to  the  recommended 
configuration  are  delineated  and  the  cost /benefit  trade-offs  of 
these  options  are  discussed. 

It  is  intended  that  this  approach  take  ACTO  another  step  furtnur 
toward  the  definition  of  that  modular  set  of  components  suitable 
for  all  scenarios  presented  in  chapter  2  'and  discussed  in  detail 
in  the  ACTO  report  on  storage  media  (Bunderson  ,  Pett  and  Beams'"'!)  . 
1981).  In  other  ACTO  studies  furthur  analysis  can  be  accomi I i su>  d 
bearing  on  high  risk 'high  cost  trade-offs,  and  detailed  specifi¬ 
cations  can  be  written 

A  few  summary  observations  from  our  research  may  help  to  gi.ic**. 
the  following  discussion: 

Some  selection  criteria  are  more  important  than  others. 
c u r r e n  t  Cue  / Sec  delivery  system  p i  o\  i  d e s  color,  sou n c  ,  n. .  .  .  c  * •  < 
and  student  control  of  pacing.  In  other  words,  one  low-, 

svstem  alreadv  in  us-  delivers.  many  of  the  features  invest  :  -a :  •.  u 
here.  The  TEC  i  r.st  ruction  is  a  quantum  1  eaj  over  older  a:  ;  !<•.»,  • 


Why  then,  if  the  delivery  system  and  the  materials  are  good, 
are  they  not  much  used?  There  are  many  reasons,  and  most  of 
them  will  confront  any  new  delivery  system.  Historically, 
when  one  investigates  changes  that  stick  one  usually  finds 

that  they: 

1.  are  new  tools  that  leverage  work  by  making  it 
more  efficient,  thereby  providing  a  competitive 
advantage  over  older  tools. 

2.  are  organizational  or  structural  changes  that  add 
a  layer  of  people. 

3.  are  easily  monitored  so  that  observers  can  easily 
see  if  they  are  used. 

4.  create  a  constituency  that  wants  to  support  the  innovation 

From  our  observations,  any  individualized  instruction  like 
TEC  can  conflict  with  the  need  for  NCO's  to  maintain  respon¬ 
sibility  for  training.  It  can  thus  alienate  rather  than  create 
a  constituency.  We  observe  NCO’s  using  TEC  lessons  the  night 
before  they  will  present  the  stand  up  lecture.  Or  TEC  lessons 
used  by  groups  of  soldiers  because  training  is  for  teams.  The 
delivery  system  must  either  have  the  power  to  change  the  structure 
(as  the  automobile  changed  urban  society)  or  it  must  adapt  to 
an  existing  constituency. 

In  order  to  be  successful,  the  new-  electronic  delivery  system 
must  provide  in  great  measure  the  most  important  feature-- 
interact  icr, .  In  our  judgment  this  feature  far  outweighs  all 
the  others.  If  NCO's  and  soldiers  have  a  sufficiently  powerful 
tool  that  provides  interactions,  they  will  find  ingenious  ways 
to  get  the  most  from  it  regardless  of  the  specific  input  and 
output  conf igurat ion .  Interaction  requires  a  computer.  With 
that  capability,  it  is  possible  to  replicate  dynamic  interchanges 
between  an  excellent  instructor  and  a  soldier.  There  is  a 
threshold,  a  minimum  level  or  power,  beyond  which  order  of  mag¬ 
nitude  increases  in  productive  work  become  possible.  That  power 
in  computers  is  now  becoming  widely  available.  It  is  a  new  tool 
which  can  leverage  the  work  of  soldiers,  instructors,  and 
commanders.  Such  a  tool  is  the  most  important  characteristic  ci 
changes  that  stick.  It  is  the  central  element  of  the  electronic 
delivery  system. 

Nothing  else  matters  about  the  electronic  delivery  system  it 
it  is  not  used.  Computer  interactions  that  are  engaging.  hav<-  rm’. 
importance  for  the  job.  and  are  sensorily  stimulating  have  the 
greatest  r-otcnf>  being  used. 

Other  features  can  be  roughly  ranked  from  most  to  least  importance  a 
sound,  color,  resolution,  photo  realism,  and  metier..  As  ch  -  rr: :  •  h 
in  detail  in  Chapter  3.  there  is  seldom  one  best  level  of  ties-, 
features.  Instead,  the-  degree  of  resolution,  and  the  best  u.--  •;  : 

sound,  color,  photo  realise:,  and  motion  depends  or.  the  cor*.  •  a*,  ar.  : 
the  soldier. 

The  following  section.'  present  alternate  coni  igurat  ions  i  or 
each  system  type. 
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Basic  System  Components 

The  basic  system  applies  to  all  desk  top  applications  in  a 
sheltered  environment.  The  militarized  version  for  use  in  the 
field  is  treated  as  an  option  within  the  basic  system.  Hand 
held  components  are  presented  separately. 

The  basic  system  includes  the  following  components  discussed 
below:  processing,  higher  order  languages,  storage,  software 

user  utilities,  and  shared  resources  at  a  site. 

Figure  8-1  presents  the  candidate  features  for  the  basic 
system.  For  each  type  of  component ,  a  low  cost  config¬ 
uration  is  also  presented  where  feasible.  Projected 
original  equipment  manufacturer's  (OEM)  prices  for  1985 
are  included.  These  prices  are  based  upon  a  quantity 
5,000  purchase.  The  prices  are  expressed  in  real  1981 
dollars,  and  therefore  must  be  revised  upward  to  reflect 
general  inflation  in  order  to  arrive  at  nominal  1955 
dollars. 


Processing .  The  preferred  central  processor  for  this 
system  is  the  32  bit  military  computer  family  system  with 
256  K  of  random  access  memory  (RAM.)  minimum.  The  32  bit 
military  family  was  selected  because  it  is  likely  to  be 
the  standard  throughout  the  Lepartnent  oi  be: ease. 

An  optional  system  for  field  use  requires  a  mi 1  it ar izea 
32  bit  processor  and  militarized  random  access  memory. 

As  might  be  expected,  this  option  is  more  expensive. 

The  minimum,  cost  option  would  be  to  use  a  16  bit  commer¬ 
cial  microprocessor  with  25GK  of  RAM.  The  cost 
differences  between  the  32  bit  and  16  bit  micro  processors 
are  expected  to  be  minimal  in  1985  and  to  decrease  there¬ 
after.  The  16  bit  micro  offers  sufficient  capability  to 
accomplish  sophisticated  training.  It  is  therefore  one  of 
the  candidate  systems.  On  the  other  hand,  a  standard 
microprocessor  which  is  compatible  with  others  throughout 
the  Department  of  Defense  may  have  long  run  cost  benefits 
which  transcend  the  immediate  hardware  acquisition  cost. 


Hardware  Links.  Vie  recommend  that  each  system  include  a 
variety  of  serial  and  parallel  ports  using  the  standard 
connectors.  This  will  greatly  enhance  the  ease  of  plug- 
compatible.  modular  hardware  integration,  which  was  one  of 
the  criteria  presented  earlier  for  electronic  deliver;,  syst-.  ■  - 
Optional  connectors  may  make  use  of  ports  which  are  exr»ect*.  a 
to  be  standardized  but  have  not  yet  come  into  general  use . 
and  militarized  ports  with  rugged :  zed  connectors  for  field  u.-- 
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So  ft  wa  re  Corununicat  ion  Proto  col  .  It  is  proposed  that  both 
synchronous  and  asynchronous  com.mun  1  cat  i on  protocols  bc- 
available  for  the  system.  This  is  another  major  factor  in 
the  ease  with  which  systems  can  be  linked  in  a  network  for 
exhange  of  information.  Some  of  the  protocols  are  relatively 
cumbersome  because  they  must  handle  a  very  wide  variety  of 
conditions.  Protocols  for  transfer  of  information  at  a 
local  level  need  not  be  as  complex  as  some  of  the  standard 
protocols  presented  here. 


Higher  Order  Languages.  We  recommend  that  the  system  run 
a  variety  of  higher  languages,  and  not  be  dedicated  to  a 
single  language  type.  This  will  permit  use  of  existing 
materials  to  a  much  greater  extent.  The  languages  recommended 
are  ADA,  FORTRAN ,  Pascal,  BASIC,  and  "C” .  These  languages 
should  all  be  available  to  run  on  the  system,  but  need  not 
be  available  simultaneously. 


Storage .  The  preferred  storage  system  consists  of  a 
storage  station  which  utilizes  a  30  megabyte  Winchester 
disk  with  tape  cartridge  backup  and  controller.  This 
common  storage  is  shared  by  from  two  to  100  users.  Our 
observations  at  a  number  of  military  bases  indicate  that 
the  average  number  of  work  stations  connected  to  each  storage 
station  is  likely  to  be  in  the  range  of  four.  Therefore  in 
estimating  costs,  the  $1200  cost  of  the  Winchester  disk 
and  its  controller,  the  $1200  cost  of  the  tape  backup  system 
and  its  controller,  and  the  S200  cabinet  is  divided  by  an  average 
of  four  users  to  arrive  at  an  approximate  cost  of  S650  per 
user  for  this  type  of  storage.  Optional  means  of  storage 
include  an  ID  Card  reader /writer ,  militarized  solid  state 
memory  for  use  in  the  field,  and  dedicated  10  megabyte 
Winchester  disk  drives  with  tape  backups  and  controllers 
fo-  t  ■■  on  a  stand  alone  system. 

The  minimum  cost  option  uses  a  dual  sided,  double  density 
floppy  disk  containing  between  two  and  four  megabytes,  with 
its  controller. 


Software  User  Utilities.  It  is  recommended  that  a  number 
of  utility  software  packages  be  available  on  almost  every 
system.  If  the  Arm-:  makes  a  large  purchase  of  hardware, 
some  or  all  of  these  software  utilities  should  be  provide  a 
free  from,  the  manufacturer.  These  utilities  include  a  data 
base  management  system,  which  would  be  especially  useful  for 
NCO  ’  s  .  commanders  .  and  others  charged  with  administ  rat  ior. . 
Other  utilities  include  a  report  generator  which  selects  an  a 
reports  data  from,  a  data  base,  electronic  mail,  word  pro¬ 
cessing.  and  a  sort  merge  capability  which  can  be  used  tc 
manipulate  data  files. 


Shared  Resource-?  At  A  Sue,  It  is  not  necessary  to  c-qu:r 
every  electronic  delivery  system  with  every  option.  In  fact, 
that  would  be  very  wasteful.  Instead,  we  recommend  that  some 
capabilities  be  available  on  a  site  basis  which  can  then  be  use 
to  support  many  work  stations.  Among  the  utilities  recommend- d 
are  a  200  character  per  second  dot  matrix  printer  for  producing 
low  quality  hard  copy  printouts  and  a  1200  Baud  modem  for 
communication  with  other  units.  As  an  option,  a  letter  quality 
printer  can  be  available  for  word  processing  appl i cat i ons . 

This  printer  will  operate  at  a  slower  speed  than  the  dot  matrix 
printer  described  above,  but  will  produce  higher  quality  rutiut 

Ar.alvs is  for  the  Instruction  System. 

This  system,  tyre  uses  the  basic  system  component?  described 
above,  and  adds  a  response  and  a  display  capability.  Figure 
8-2  presents  the  candidate  features  for  this  system,  and  F;  gu  re¬ 
presents  the  cost  summary. 

K-  _  .  The  preferred  components  for  this  system  include 

both  a  keypad  and  a  touch  panel.  The  keypad  is  used  primarily 
for  functional  commands,  while  the  touch  panel  permits 
interactions  with  variable  information  as  it  is  presented 
on  the  screen.  These  two  components  may  be  used  singly  or  in  c: 
j  un  ct  i  or. . 

Oct  ior.al  response  mechanisms  include  a  high  quality  voice 
input  system,  2  keyboard  where  users  are  typists  and  where  the 
volume  of  information  is  high,  an  inexpensive  joy  stick  or 
mouse  as  an  alternative  to  the  touch  panel,  a  valuator  (e.g.. 
rheostat  or  game  paddle  on  the  Apple),  and  a  track  ball. 

These  options  reflect  a  sense  from  experiment  five  of  the 
present  study  and  from  our  research  that  a  keypad  and  touch  par. 
system  are  most  appropriate  for  the  wide  variety  of  soldiers 
applications.  The  keypad  and  touch  panel  can  be  used  in  cor.jun 
or  by  themselves.  The  optional  capabilities  were  judged  to  hav 
fewer  application?  .  but  to  be  adequate  in  terms  of  the  select : r 
criteria. 

Di  s  p  1  a ;.  .  The  preferred  display  feature  includes  nediur 
resolution  color  graphics  and  color  motion  presentation  cam! 
(e.g..  ;;73C  videodisc  player  and  controller  interf  )  . 

Options  include  a  projection  television  system  for  large 
audiences,  and  a  digitized,  random  access  telephone  quality 
voice  output  system. 

An  alternative  system  might  be  considered  as  an  option.  Th :  .- 
system  is  all  digital,  and  sacrifices  color  and  the  real  ism 
available  on  a  videodisc  while  maintaining  a  graphics  capa¬ 
bility  (albeit  of  lower  quality).  This  di  spl  ay  system  ust  a 
low  to  medium,  resolution  (e.g..  300  X  -300  pixel  s  )  mor.ov.hrer  • 

. w 1 1  h  t‘-\t  ar  *raph  :  c?  pack: 

A  minimum  cost  opt  i  or.  maintains  the  color  and  mot  ion  capab :  lit  .  • 
which  might  be  provid'd  by  a  videodisc,  but  significant  I)  d-  - 
creases  the  text  and  graphics  capability.  This  sysur.  cc  r.s  :  st 
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.-•nded  Features  ior  the  Instruction  System 
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an  NTSC  color  moniter ,  an  NTSC  text  and  graphics  character 
generator,  videodisc,  and  interface  control.  This  type-  of  system 
might  be  limited  to  placing  24  lines  of  31  characters  each  on 
the  screen,  or  low  resolution  graphics  on  the  order  of  192  X  25G 
pixels . 

The  reason  for  specifying  color  in  the  preferred  system  is  that 
an  electronic  delivery  system  is  self  paced,  and  color  has  been 
shown  to  increase  performance  in  self  paced  instruction,  as  well 
as  to  result  in  higher  retention.  These  effects,  as  noted  above, 
are  available  only  if  the  learner  is  given  time  to  assimilate 
the  color.  This  system  would  allow  for  color  coding,  which  has 
been  shown  to  result  in  faster  and  better  comprehension .  Color 
has  also  been  shown  to  be  preferred  over  black  and  white,  and 
it  may  thus  be  a  factor  in  decreasing  attrition. 

If  a  videodisc  is  planned  in  order  to  present  motion  sequences,  th-: 
system  should  also  be  able  to  provide  color  in  order  to  take  full 
advantage  of  the  capabilities  of  the  videodisc.  The  system 
proposed  here  uses  a  single  terminal  to  present  both  medium  resolution 
computer-controlled  graphics  and  NTSC  video  images.  This  system, 
uses  a  comb  filter,  with  three  color  planes,  allowing  un  to  eight 
color  combinations  for  graphics,  which  can  be  overlayed  on  the  video 
image.  Either  image  may  also  be  presented  separately. 


The  inclusion  of  a  color  graphics  terminal  significantly  increases 
the  cost  of  the  preferred  system  over  the  cost  of  either  an 
all  digital  system  or  a  low  resolution  NTSC-only  system.  What 
does  the  medium  resolution  system  buy  in  relation  to  a  low 
resolution  system.0  And  what  does  the  color  motion  capability  buy 
in  relationship  to  a  low  to  medium  resolution  monochrome  all 
digital  graphics  system0 

WICAT  has  had  considerable  experience  using  low  resolution  color 
text  and  graphics  overlays  on  videodisc  images.  We  find  this 
capability  to  be  extremely  important  for  generative  items  and 
for  making  corrections  to  the  videodisc  presentation.  On  the 
other  hand,  the  text  limitations  are  such  that  only  minimal 
amounts  of  poster-like  information  can  be  placed  on  the  screen. 

It  would  not  be  feasible  to  use  the  system  to  present  much  text. 
Moreover .  the  graphics  capability  is  limited  by  the  192  X  25C 
pixel  resolution  and  by  the  pragmatic  requirement  to  define  lir.vs 
of  several  pixels  width.  The  system  is  usable,  and  yields 
attractive  graphics  for  large  figures.  On  the  other  hand,  the 
Texas  instruments  9918  video  display  processor  which  we  use  is 
not  well  adapted  to  presenting  fine  details,  for  example 
meter  f  a*-es>  .  Therefore,  a  medium  resolution  (  approx  a  mat  el  % 

512  X  512;  system  adds  the  capability  to  i  resent  relatively  f : 
lines..  This  makes  the-  difference  between  being  able  to  prvs-. 
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meter  displays,  for  example,  in  a  two  dimensional  simulation 
or  not.  This  resolution  is  approximately  oquivi  lent  to  that 
of  the  PLATO  system.  We  have  prepared  an  extensive  simulation 
on  PLATO,  and  find  it  a  very  useful  tool  to  have  this  level 
of  resolution  available. 


The  second  comparison  is  between  the  color  motion  features 
available  in  the  preferred  system  and  the  monchrome  low  to  medium 
resolution  all  digital  graphics  system.  He  feel  confident 
from  the  literature  review  and  other  research  conducted  for 
this  study  that  a  great  deal  of  very  effective  training  car. 
be  presented  with  a  low  to  medium,  resol  ut  ion  mor.ocr.rome  graphics 
system  as  described  here.  The  advantage  of  using  the  computer 
graphics  for  either  of  the  systems  is  that  computer  generated 
graphics  perm.it  rapid  modi  f  i  cat  i .  r.s  to  a  program  to  he  made 
on-site,  as  opposed  to  the  delays  associated  with  making  changes 
on  a  videodisc.  Security  can  also  be  easily  achieved  using 
the  magnetic  medium.  To  make  optical  videodiscs  s\ stems  secure 
is  more  difficult.  The  videodisc  material  can  simply  be  locked 
in  a  safe,  much  as  classified  printed  material  is  today.  Level  - 
the  less,  while  it  is  in  the  player  it  is  vu  1  n  r  rah  1 r- .  Th  i  c  is  some 
less  the  case  with  a  magnetic  medium.  Both  the  videodisc  and 
computer  generated  text  and  graphics  permit  zooming  in.  On  the 
videodisc  this  is  a  c  comp]  i  shed  by  a  succession  of  pi  cturc-s  taken 
ever  closer  to  the  suttee:.  In  a  crannies  system,  zoom,  mav  be 
accomplished  through  hardware  and  software  manipulation  oi  a 
single  data  base. 

The  advantage  oi  cojor  motion  over  rr.or.ocnromc-  stm  .t  ana  animation 
is  that  some  procedures,  where  motion  is  critical  or  where  time 
sequences  must  be  portrayed,  car.  best  be  presented  in  a  video 
format.  Moreover,  human  models  car,  be  much  more  easily  presented 
by  a  video  system,  than  by  computer  graphics.  The  video  also 
permits  presentation  of  existing  slide-tape,  video  tape,  and 
film,  materials.  In  these  areas,  videodisc  color  and  motion 
sequences  have  the  advantage.  On  the  other  hand,  the  cost  o: 
preparing  a  videodi.se  and  the  difficulty  of  making  changes  are 
disadvantages.  On  balance,  we  feel  that  marrying  the  color  and 
motion  features  of  a  video  system  with  the  capabilities  of  a 
medium  resolution  graphics  system  yields  all  of  the  benefits  of 
both  approaches  while  minimizing  their  respective  disadvantages. 


The  other  element  of  comparison  for  the  preferrred  system  in 
relation  to  the  all  digital  monochrome  graphics  system  is  in 


the  area  of  sound.  In  some  sense  th 


sou no  cone 


r  e  e  wit  h 

motion  or,  a  videodisc.  That  is,  buying  the  motion  feature 
also  buys  the  sound  capability.  This  statement  can  be  mislead 
however,  unless  still  i  rame  audio  is  available.  Still  frame 
audio  permits  ur  to  30  seconds  oi  audio  to  be  prose  r  t  e-d  with 
each  still  picture.  Currently,  30  frames  of  pictures  must  be 
used  for  each  second  of  audio .  If  t ho  vicieodi.se  is  used  lor 
audio  without  a  still  :  ram*  capability,  the  via- o  segments  art 
almost  wasted  because  a  single-  sti.il  v  i  dec*  image  is  repea .  e-„ 
30  times  pe-r  second  while  the 
about  videodisc  sound  apply  as 
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while  the  videodisc  permits  rapid  searching  and  therefore  a 
form  of  random  access  audio,  it  is  somewhat  limited  in  this 
regard  by  the  speed  with  which  various  motion  and  audio  seg¬ 
ments  can  be  accessed.  Therefore,  while  the  preferred  system 
does  indeed  offer  a  capability  for  sound,  it  is  not  the  computer 
generated  or  very  fast  random  access  voice  and  soundwhich  is  avail 
some  other  systems.  There  is  nothing  preventing  the  addition 
of  such  a  capability  to  the  preferred  system.  However,  these 
capabilities  are  not  required.  Videodisc  audio  is  likely  to  be 
acceptable  for  most  applications. 

The  all  digital  graphics  system  could  also  have  the  random 
access  audio  provision  added  to  it.  In  this  wav  it  could  have 
even  more  powerful  sound  capabilities  than  the  t  a  s i c  preferred 
system.  Sound  is  not  a  sufficiently  higr.  priority  feature 
by  itself  (i.e.,  apart  from  color  video  motion'  10  be  included 
in  a  low  cost  system.  Figure  S-3  presents  a  cost  sumr.'.arv  of  the 
three  basic  configurations  described  above. 


Analysis  for  the  Administration/Manacement  System 

A  preferred  and  a  minimum  cost  configuration  have  been  prepared 
for  this  system  type.  The  two  configurations  with  their 
options  are  compared  in  Figure  8-4.  Figure  8-5  presents  a 
comparison  of  the  expected  total  costs  for  the  two  systems  in 
their  basic  configurations. 

The  primary  difference  between  the  preferred  and  the  minimum, 
cost  systems  are  the  CPU,  the  means  of  storage,  and  the  presen¬ 
tation  device.  The  preferred  system  makes  use  of  the  32  bit 
military  computer  family  CPU  while  the  minimum  cost  version 
uses  a  16  bit  commercial  CPU.  These  differences  were  described 
in  the  previous  section.  The  preferred  system  also  uses  a 
shared  30  megabyte  Winchester  disk  with  tape  backup.  The 
minimum,  cost  configuration  uses  a  floppy  disk.  Both  use 
a  keyboard  because  it  is  expected  that  administration  personnel 
will  know  how  to  type  and  because  the  volume  of  data  entry 
makes  a  touch  panel  or  keypad  less  attractive.  Finally, 
the  preferred  system  uses  the  medium,  resolution  color  terminal 
which  was  described  with  the  instruction  system  type,  while 
the  minimum  cost  configuration  uses  the  monochrome  graphics 
terminal  described  in  that  same  system,  type.  It  should  be 
noted  that  neither  system,  includes  a  videodisc.  It  shoulc 
also  be  noted  that  these  systems  are  intended  T o  be  plug 
compatible  and  modularly  interchangeably .  By  this  is  meant 
that  to  make  the  admini  st  rat  ion  .-management  system  into  ar. 
instruction  system  the  appropriate  peripherals  lor  the  ne  v. 
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Cost  Summary 
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required  features  would  simply  be  plugged  in.  This  modularity 
and  interchangeability  is  a  critical  factor  in  mc-eting  the 
decision  criterion  which  specifies  low  hardware  ownership 
costs  and  high  benefits  for  plug  compatible  components. 
Availability  of  systems  is  likely  to  be  maximized  if  parts 
are  interchangeable.  It  could  be  expected  that  both  systems 
would  include  access  to  an  on-site  modem  for  connection  to 
external  computer  networks  and  data  basis. 

The  preferred  system  uses  a  shared  memory  so  that  information 
can  be  readily  accumulated  in  a  central  data  base  and 
shared  among  a  number  of  users  who  are  in  close  physical 
proximity  (i.e.,  wherever  a  coaxial  cable  can  be  run).  The 
minimum  cost  system  uses  a  floppy  disk  which  would  be 
physically  transported  to  another  system  if  someone  else 
were  to  need  the  data. 

The  case  for  the  expensive  medium  resolution  color  terminal 
as  opposed  to  a  lower  resolution  monochrome  terminal  is 
less  strong  for  this  system]  type.  Most  of  the  evidence 
supporting  the  use  of  color  for  management  presentations 
is  anecdotal.  The  cost  differenceis  over  $3,000.  Therefore, 
while  we  recommend  a  color  higher  resolution  system  for 
this  system  type,  we  feel  that  the  cost /benef it s  case  is 
less  strong.  In  fact,  it  is  likely  that  the  choice  of 
terminals  for  the  admin i st rat  ion /management  system  would  be 
determined  by  the  choice  of  terminals  for  the  instruction 
system.  If  the  higher  resolution  color  terminals  are  chosen 
for  the  instructional  system,  then  compat abi 1 ity  for  the 
administration /management  system  would  be  valuable.  On 
the  other  hand,  if  cost  were  extremely  critical,  the  lower 
resolution  monochrome  system  or  the  NTSC  video  only  system, 
might  be  chosen.  If  the  instruction  system  is  configured 
with  the  lower  resolution  monochrome  terminal,  then  the 
adm.inistrat  ion /'management  system  would  certainly  use  the 
same  terminal.  If  the  instruction  system  uses  the  NTSC 
video  only  terminal,  then  a  separate  text  and  graphics  termina 
would  be  required  for  administration. 


Analysis  for  the  Job  Aiding  System. 

Figure  8-6  presents  the  preferred  and  minimum  cost  components 
for  this  system  type.  Figure  8-7  presents  the  cost  summary 
for  comparing  the  two  configurations. 

The  CPU’s  for  both  systems  are  militarized.  One  uses  a 
32  bit  CPU  while  the  other  one  uses  a  16  bit  CPU.  Both 
use  militarized  FLAN!.  Both  also  use  a  militarized  one 
megabyte  solid  state  memory. 

Although  there  is  no  difference  between  the  preferred  and 
minimum  cost  systems  for  the  solid  state  memory,  the  quart  it; 
of  this  memory  is  a  critical  determinate  of  total  syst-.  r  ce.-t 
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for  both  systems.  The  ACTO  Storage  Media  Project  estimated  t 
as  much  as  15  megabytes  of  solid  state  ..,emory  might  be 
required  for  this  job  aiding  application.  We  have  esti¬ 
mated  that  magnetic  bubble  memory  in  quantity  5,000  purchases 
in  1985  will  cost  approximately  S1425  per  megabyte.  These 
prices  are  in  terms  of  real  1981  dollars,  and  must  be 
adjusted  for  inflation.  Therefore  if  15  megabytes  is 
required  instead  of  one  megabyte,  the  cost  of  this  system 
could  reach  nearly  $30,000.  This  is  clearly  far  out  of 
range  of  tolerable  costs.  We  therefore  feel  that  the 

kinds  of  job  aiding  materials  placed  on  this  system,  and 

the  scenarios  for  their  use,  should  reflect  the  more  con¬ 
servative  memory  figures  used  here. 

Both  the  preferred  and  the  minimum,  cost  systems  use  a 
militarized  keypad.  The  preferred  system,  however,  includes 
a  voice  input  system  as  an  aid  to  the  soldier  when  hands 
and  eyes  are  busy.  There  is  not  a  good  body  of  research 

yet  to  describe  the  efficiency  gains  to  be  achieved  with 

voice  input.  However,  anecdotal  evidence  over  the  last 
decade  indicates  that  for  specific  applications  where 
hands  are  usually  full  (e.g.,  baggage  handling,  quality 
control  inspections,  and  numerical  machine  coding)  voice 
input  can  make  a  significant  difference.  The  inclusion 
of  a  voice  input  system  in  the  preferred  configuration 
is  therefore  a  matter  of  opinion,  and  subject  to  verification 
in  field  evaluat ions . 

Both  the  preferred  and  the  minimum  cost  systems  use  a 
militarized  flat  panel  display.  The  display  is  projected  to 
be  a  monochromatic  svstem. 

i\o  videodisc  is  recommended  for  job  aiding  in  the  field  becau 
of  the  difficulty  in  ruggedizing  a  videodisc  player.  However 
the  videodisc  may  be  an  excellent  choice  for  garrison  job 
aiding . 

Analvsis  for  the  Authoring  Svstem 


Figure  8-8  presents  the  system  alternatives  for  this 
system  type.  Figure  8-9  presents  costs  for  the  pre¬ 
ferred  and  minimum  cost  basic  systems.  Both  configurations 
add  a  graphics  tablet  for  entry  of  graphics  information, 
and  whatever  keypad,  touch  panel,  and  valuator  data  entry 
capabilities  are  required  to  match  the  capabilities  of  the 
instructional  delivery  systems.  A  keyboard  is  also  added 
for  interaction  with  an  authoring  management  system. 

The  primary  difference  between  the  preferred  and  the  minunur 
systems  is  in  the  display  terminal  (medium  resolution  color  g 
with  NTSC  video  vs.  a  low  to  medium  resolution  monochromatic 
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monitor  with  text  and  graphics).  The  choice  between  these 
two  presentation  feature  components  will  surely  be  de-term:  ned 
by  the  selection  made  for  the  authoring  system. 

If  the  instructional  delivery  system  chosen  includes  a 
color  and  motion  video  capability,  then  the  authoring  and 
production  system  type  must  include  a  videodisc  player, 
studio  quality  color  text  and  graphics  character  generator, 
and  video  tape  editor.  Naturally,  these  resources  are 
shared  across  a  large  number  of  users.  Nevertheless,  they 
do  represent  substantial  costs.  For  example,  the  studio 
quality  character  generator  can  be  expected  to  be  priced 
in  the  $60,000  range. 


Analysis  for  the  Ratine  and  Inventory  System. 

This  system  is  presented  in  Figure  8-10.  No  options  or 
lower  cost  alternatives  are-  presented,  since  it  was  felt  that 
the  basic  coni igurat ion  is  already  at  a  low  cost  and  that 
no  additional  peripherals  are  required.  This  system  includes  a 
battery  operated  computer  with  a  "small  flat  display  and  keypad. 
Nonvolatile  RA”  is  used  to  hold  data  even  when  the  power  is 
off.  The  data  entr\  device  can  be  plugged  into  another  syster. 
upon  return  from  the  field,  and  the  data  can  then  be  transferred 
into  a  standard  data  base  management  system. 
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CHAPTER  9 
LOOKING  AHEAD 


GENERAL  CONCLUSIONS  FROM  THE  THREE-PERSON  AND  SCENARIO  ANALYSIS 


The  old  delivery  systems  have  not  sufficiently  dealt  with  certain 
necessary  functions.  These  include: 

1.  Teacher  quality  assurance- -especi al ly  for  distributed 
training  involving  NCO's  and  training  officers  in  units. 

2 .  On-the-iob  training  delivery  and  future  assurance . 

There  are  many  aspects  to  this  because  it  has  not  beer, 
possible  to  perform  it  adequately  with  print  and  voice 
communications,  or  with  linear  audio  visual  materials. 
Thus  many  partial  scenarios  and  sub-scenarios  have  had 
to  be  projected  to  define  how  to  implement  such  systems 
using  new  technologies. 

3.  Related  to  the  inadequacy  of  the  current  delivery  system, 
for  on-the-job  training  and  testing  is  a  deficiency  in 
learner  quality  assurance.  Quite  aside  from  the  re¬ 
cruiting  and  enlistment  organizations  that  now  exist, 
improving  basic  skills  is  a  part  of  learner  quality 
assurance.  It  must  take  place  on  the  job.  Basic  skills 
improvement  is  not  well  integrated  into  a  total  on-the- 
job  and  future  assurance  system.  The  present  Basic  Skill 
Educational  Program  (BSEP)  can  be  useful,  but  must  be 
well  integrated  into  on-the-job  training  in  the  units. 


One  of  the  most  critical  functions  identified  in  the  scenario 
analysis  was  that  of  materials  development  and  improvement.  Much 
progress  has  been  made  by  the  Army  in  this  area.  The  Army  has 
been  a  pioneer  in  Instructional  Systems  Development  (ISD)  and 
distributed  training.  However,  much  more  needs  to  be  done  because 
the  materials  development  and  improvement  function  is  the  major 
driver  of  both  the  current  problem  and  its  solution.  The 
numerous  centers  in  the  Army  where  authoring  of  materials  tak-..~ 
place  now  are  the  source  of  the  paper  glut  that  affects  train:,".:  . 
maintaining,  and  general  communications.  These  materials  dovelo: - 
ment  and  distribution  centers  mu  t  be  transformed  so  that  they  car. 
distribute  new  optical  memories  and  materials  in  electronic 
forms  over  networks.  The  authoring  system  technologies  to  aid 
them  in  so  doing  is  perhaps  the  most  critical  development  issu<- 
that  the  Army  faces.  This  is  the  key  to  improving  currently 
weak  delivery  systems,  teacher  quality  assurance  in  the  field, 
on-the-job  training  and  future  assurance , and  learner  quality 
assurance  (through  programs  like  BEET). 


The  remainder  of  this  chapter  gives  more  specific  conclus 
and  recommendations .  These  will  be  organizes  uncor  three 
major  types  of  delivery  systems:  the  electronic  col  ivory 
(EIDS)  hardware  for  job  training ,  the  ERA'S  hardware  for 
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repair  bases  and  in  the  field,  and  the  hand-held  system.  The 
"issue's  remaining"  discussed  below  were  derived  from  what  the 
authors  perceive  as  the  design  areas  where  the  greatest  potential 
benefits  exist,  or  where  soft  technology  issues,  il  not  resolved, 
introduce  the  greatest  risk  of  failure.’  Issues  regarding  local 
network  communication  and  storage  will  not  be  considered  in  this 
chapter,  as  these  matters  are  not  the  function  of  the  presentation 
features  study. 

CONCLUSION’S  AND  RECOMMENDAT I ONS  FOR  THE  ELCTRONIC  DELIVERY  SYSTEM: 
Hard  Techr.oloav  Issues 


tisual  Displays.  The  following  conclusions  were  drawn  regarding 
visual  displays: 

®NTSC  color  video  displays  arc-  acceptable  if  they  include 
computer  text  and  graphics.  It  will  be  c-asy  to  convert 
existing  audio  visual  materials,  but  print  will  require 
extensive  reformatting.  After  reformatting.  NTSC 
color  displays  are  quite  suitable  and  the  cost  of  reformat¬ 
ting  can  yield  benefits  in  speed,  effectiveness,  and  interest/ 
motivation  if  reformatting  follows  good  design  principles. 

©Medium  resolution  color  graphics  is  preferred  for  greater 
ease  and  flexibility  in  reformatting,  for  greater  accent  a  no- 
and  interest:  and  most  insert  ant  Iv ,  for  nev.  o-tions  ir. 
computer  grannies  for  s  j’---r:  nr  t  iw-  dm^-n?  i  on  a  1  sim.ul  r.t  i  gr¬ 
and  intelligent  interactions.  There  is  a  hicn  dollar 
price  for  this  preferred  option  by  IPSA  (about  S3. 7 uo / 
and  it  will  probably  be  necessary  to  restrict  color  err.  *’t :  *•« 
to  certain  two-dimensional  simulation  applications  ai.': 
in  command  and  control  situations  v  her-'  it  can  be  well 
justified.  Medium  resolution  color  displays  should  b-  or- 
of  the  options  designed  into  the  modular  electronic  c  ''vc-r. 
configuration  even  if  it  is  not  selected  for  the  rda * 
or  company  level  training  system. 

Audit' .  Still  frame  audio  on  optical  memory  storage  systems 
( e . g .. videodiscs  )  is  an  essential  for  transferring  existing 
TEC  and  ETY  materials  to  compact  job  training  packages.  This 
is  a  conclusion  from  previous  studies.  This  study  revealed 
simply  that  such  a  large  capacity  audio  capability  will  meet 
all  existing  requirements  and  will  open  new  possibilities  for 
increased  effectiveness.  Thus,  there  is  no  need  lor  costly 
and  less  effective  digitized  or  synthesized  audio  where  optical 
memories  with  still  frame  audio  are  usee. 

Desicr.  of  the  NTSC  Videodisc  Player .  The  issue  with-  the  g  re  at  cst 
significant  impact  on  the  eventual  cost  (after  the  issue  of  r  •.  d :  ur 
resolution  color  vs.  NTSC  video  display)  is  the  NTSC  videod:.-. 
player.  The  $600  iigure  derived  in  Charter  S  is  a  risky  i  i  zur-. 
because  it  is  based  on  project  ions  for  current  optical  vide: d: Sv 
players.  These  current  players  do  not  have  still  frame  auu. ’ 

Tnus  considerable  technology  development  must  take  r  1  :u  e  m  t  h : .- 
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area.  Some  questions  that  must  he  answered  are  as  follows: 

® Car  photographic  media  syste  s  be  developed  that  will 
be  more  cost-effective  than  • he  stamped  and  aluminized 
plastic  disks? 

•Should  the  format  be  a  spinning  disk  or  a  stationary 
card? 

•Should  the  material  be  stored  in  analog  format  or  all- 
digital  format  with  Digital  to  Analog  converters  used  tr  go.r<  r 
both  audio  and  video  pictures9 

•The  resolution  of  the  questions  above  affects  the  pre¬ 
mastering,  mastering  and  replication  technologies  ccnsidc  ral 1> 
Will  local  mastering  and  duplication  be  made  available 
to  the  many  Army  sites  where  materials  development  will  take 
place? 

The  answers  to  these  questions  also  determines  the 
nature  of  authoring  systems.  Authoring  systems  aimed  at 
producing  materials  for  use  on  electronic  delivery  systems  cha 
■use  optical  memories  cannot  be  completed  and  optimized  until 
the  hard  technologv  issues  are  resolved. 

Input  Devices.  The  following  conclusions  and  recommendations  are 
made : 


•The  keypad  plus  tou~h  panel  recommendation  will  serve 
adequately,  but  research  and  development  is  needed  to  defin*'  a 
general  keypad  usable  for  all  job  trair.irp  Packages:  or  alter- 
natelv  .  a  minimum  number  of  more  specialized  k e y p  3  d  = .  This 
research  can  also  consider  the  elimination  of. the  touch  panel 
providing  cursor  control  1 rom  devices  on  the  keypad. 

•Voice  input  is  not  required  for  gesieral  job  training,  but  mat 
be  specified  as  a  plug-in  option  when  a  job  requires  vocal 
responses  to  be  trained  or  hands  or  eyes  to  be  free. 

Authoring  Sv stems  for  Job  Training  Materials 


V.'ith  plug-in  modules  and  additional  equipment,  a  variety  of 
authoring  systems  can  be  configured  for  various  development 
needs.  It  is  not  possible  to  specify  these  precisely  at  th.it 
time  because  of  the  remaining  soft  technology  issues. 

The  Army  should  pay  considerable  attention  to  the  design  of  the 
authoring  station  and  software  for  JTP  materials.  This  system, 
used  by  contractors  m  a  network  accessed  by  the  Army  contracting 
monitor,  can  provide  quality  assurance  during  development. 

Soft  Technology  or  Authoring  Strategy /Authoring  Systems  Issues 

Because  of  the  large  inventory  of  existing  job  training  materials, 
and  the  high  cost  of  electronic  displays  that  minimize  reicrr no¬ 
ting,  further  research  and  development  on  ways  to  reformat  ole 
materials  is  needed.  Eefore  authoring  systems  car.  be  corp-c t-: .  v 
specified,  some  issues  growing  out  of  the  new  scenarios  for  tr-. 
on-the-job  and  future  assurance  system,  must  also  be  selvae. 


►  h  t/> 


Recommendations  for  Reformatting.  A  number  of  investigations 
are  recommended : 

•  Still-frame  editing  is  a  costly  and  complex  problem  nov.  , 
but  adding  the  editing  problem  for  still  frame  audio  will 
complicate  it  even  further.  TEC  and  ETV  visuals  go 
directly  onto  NTSC  video,  but  the  largely  unknow  still 
frame  audio  problem  must  be  resolved.  New  authoring 
systems  for  still  frame  audio  require  research  and  devc-lcp: 

•  Printed  materials  such  as  the  Army  Training  Literature 
Program  and  the  Army  Correspondence  Course  Program  will 
require  considerable  investigation.  The  goal  is  to  dis¬ 
cover  how  to  reformat  at  minimum  cost  and  maximum  cair. 
in  effectiveness,  including  rate  of  comprehension  and 
user  interest  and  motivation.  This  will  require  the 
addition  of  interactive  capabilities  during  the 
reformatting  process. 

0  Computerized  authoring  systems  with  text  and  graphic 

processors  and  prompting  systems  for  the  authors  need  to 
be  developed.  Methods  for  getting  the  materials  into 
diaital  form--both  text  and  graphics--anc  editing  these 
materials  need  to  be  investigated  and  built  into  the 
authoring  system. 

New  Issues .  The  scenarios  defined  in  this  and  the  previous 
tudies  have  identified  a  number  of  areas  where  considerable 
urther  research  and  development  must  be  conducted.  This 
research  is  needed  to  define  the  most  cost  effective  management 
anc  instructional  approaches  and  the  best  authoring  systems  to 
support  them.  Some  of  these  issues  are: 

0  How  to  design  a  management  system  to  implement  the  Plan 
for  Continuing  Individual  Training  in  Units  (PCITU)  and 
to  extend  this  to  a  Plan  for  Continuing  Team  Training  in 
Units  (pcTTU) .  Regular  electronic  delivery  systems  can  be 
used  in  a  management  network  to  help  the  trainers  and  the 
soldiers  schedule  training  and  evaluation  in  the  field 
and  provide  a  training  accountability  record. 

0  How  can  the  KCO's  and  training  officers  be  trained  to 
train  effectively  in  the  field? 
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#  How  can  ARTEP  be  integrated  into  a  total  on-the-jcb 
training  program?  This  requires  correlation  of  group 
performance  scores  with  individual  performance  scores. 

9  How  will  it  be  possible  to  assist  in  the  resource 
management  of  training  (e.g.,  as  related  to  the  TMAC 
project? 

9  How  will  it  be  possible  to  integrate  job  aiding  in  the 

proper  mix  with  training  lessons?  Experiment  5  herein  snow 
the  increased  time  effectiveness  of  a  simple  job  aiding 
strategy  in  a  cable  assembly  task.  There  are  instructional 
strategy  issues  involved  and  also  political  issues.  TFALOC 
is  restricted  at  present  in  developing  job  aids.  Yet  the 
Army's  best  interests  seem  to  lie  in  a  much  closer 
integration  of  job  aiding  with  training  materials. 

In  all  of  the  areas  requiring  further  research  described  abzve ,  a 
major  objective  is  the  design  of  modular  authoring  system,  hard¬ 
ware  to  leverage  the  work  of  the  materials  developers.  Kays 
to  produce  the  new  materials  must  go  hand  in  hand  with  the  new 
scenarios,  delivery  systems,  and  strategies. 

CONCLUSION'S  AND  REMAINING  ISSUES  REGARDING  MILITARIZED-  ELECTRONIC 
DELIVERY  SYSTEMS  FOR  SPA's 

Hard  Technology  or  Delivery  Systems  Conclusions  and  Issues 

Display  Devices.  A  flat  panel,  bit  mapped  monochromatic 
display  with  medium,  resolution  is  quite  appropriate.  Gray  scale 
is  not  essential,  but  reformatting  of  existed  printed  SPA's 
ana  ETM  materials  is  necessary. 

There  are  some  storage  media  issues  remaining  in  the  design 
of  the  SPA's  delivery  system.  This  study  projected  a  one 
megabyte  bubble  memory  which  holds  at  least  3.3  SPA's  manuals. 
However,  after  the  storage  media  report  was  submitted,  a  new 
optical  memory  card  that  will  hold  several  megabytes  on  a 
pocket-sized  card  has  been  announced.  This  may  not  have  the 
disadvantages  of  the  optical  videodiscs  for  the  SPA's  delivery 
system,  (reliability  and  portability)  although  the  update 
problem,  would  remain.  Thus,  the  various  bulk  semiconductor 
memories  vs.  the  optical  card  memory  must  be  investigated 
closely.  The  rapid  change  in  both  of  these  technologies 
introduces  an  element  of  risk  in  current  projections. 

Audio .  Audio  output  during  maintenance  aiding  may  be  quite 
helpful  in  some  situations  but  does  not  appear  to  be  a  requirem.er.t 
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Following  this  specification  traditional  reformatting 
studies  need  to  be  conducted  to  find  the  most  cost  effective 
procedures.  These  procedures  should  be  implemented  into 
a  SPA's  authoring  system  for  use  by  those  who  will  reformat 
the  old SPA's  and  TM's. 

New  Authoring  R  &  D.  When  the  issue  is  the  design  of  displays 
for  electronic  delivery  rather  than  converting  printed  paces, 
then  the  design  of  a  SPA's  authoring  system  will  have  more 
degrees  of  freedom.  Some  issues  have  to  do  with  whether  new 
materials  are  produced  all-digital  from  the  beginning  or  not. 

The  prototype  for  the  new  electronic  SPA's  format  and  the  authoring 
systems  for  producing  the  materials  should  be  developed 
simultaneously . 

THE  HAND-HELD  SYSTE'.:  FOR  TRAINING  ANT  INVENTORY  ACCOUNTABI L I  TV 
Hard  Technology  Issues 


Display.  What  size  should  the  small  flat  panel  be?  How  many 
rows,  how  many  columns?  How  large  a  dot  matrix?  What  flat 
panel  technology  should  it  use?  How  much  local  memory?  While 
the  findings  of  this  study  provide  guidance,  the  answer  depends 
on  the  content  of  AP.TEP ,  SQT ,  and  inventory  applications. 

How  many  functions  should  the  hand-held  data  entrv  commuter  perform 


.  Scoring  for  SQT  and  AKTEP? 

.  Inventory  management? 

.  Rapid  field  calcul at  ions? 

.  Should  this  double  as  a  keypad  for  workstations? 

Portable  Storage.  Should  the  hand-held  unit  have  a  built-in 
optical  or  memory  card  reader? 

Input  Devices.  How  many  keys  should  the  keypad  have?  How- 
can  they  be  redefined  for  multiple  uses?  Should  there  be 
cursor  control  mechanisms  on  the  keypad? 

Soft  Technology  Issues.  The  emergence  of  the  hand-held  unit 
represents  a  critical  area  for  research  and  development.  It 
is  fairly  recent  in  the  ACTO  series  of  studies,  and  it  is 
based  on  new  scenarios  for  the  job  training  and  future 
assurance  scenarios  which  themselves  are  quite  new.  Thus 
there  are  many  soft  technology  issues  that  depend  on  how 
the  hard  technology  issues  are  resolved.  For  example,  how 
much  memory  can  be  contained  in  the  hand-held  unit?  If  ar. 
optical  card  or  storage-  chip  card  is  to  be  inserted  in  the 
hand-held  unit  the  unit  can  do  many  more  things  than  if  it 
must  only  contain  built-in  semiconductor  memories. 

However  the  storage  issue  is  resolved,  there  is  a  materials 
development  and  programming  issue  concerning  the  inventory  manage¬ 
ment  protocols,  and  any  other  protocols  that  will  be  implemented 
using  the  same  hand-hold  unit.  There  are  also  human  factors  and 


interaction  strategy  issues  that  have  not  yet  been  defined 
or  investigated. 

FINAL  COMMENTS 


This  is  not  an  easy  study  to  summarize.  There  are  many  detailed 
recorr.'  ndat  ions  in  the  executive  summary  and  in  the  chapters. 
These  -  a 1  with  the  nuances  of  when  different  presentation 
features  are  more  effective  and  advantageous.  A  choice  was  made 
to  focus  this  final  chapter  on  those  conclusions  that  are  most 
related  to  cost  -benef  i  ts  and  seem  most  solid,  and  those  remainir. 
issues  which  need  to  be  addressed.  These  issues  require  resolut 
before  the  opportunity  of  the  new  electronic  and  communication 
technologies  car.  be  fully  realized  by  the  Army. 

One  general  conclusion  is  that  the  technology  has  progressed 
far  enough  to  present  a  variety  of  attractive  alternatives. 
Further  research  and  development  can  only  lead  to  more  ways 
to  cut  costs  and  increase  benefits  as  the  hard  technology 
and  soft  technology  issues  are  resolved.  There  do  not  appear 
to  be  any  major  risk  factors  in  resolving  the  hard  and  soft 
technology  issues  discussed  herein.  Thus,  the  Army's  greatest 
need  is  decisiveness  and  commitment  in  seizing  the  opportunities 
for  improving  force  readiness  through  greatly  improved  training, 
maintaining,  and  communicating,  which  these  new  technologies 
offer. 
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APPENDIX  A 


SOME  EFFECTS  OF  REALISM  AND  JOB  AIDING  FOP.  INSTRUCTION' 
PRESENTE;  VIA  a  VIDEODISC 

EXPERIMENTS  I  AND  II 


The  transfer  of  training  material  from  paper  to 
videodisc  requires  more  than  mere  transfer;  it  requires 
transformation.  A  printed  training  manual  has  the  advantage 
of  years  of  research  and  development  behind  it;  thus  when  a 
new  manual  is  developed,  well  established  guidelines  are 
used.  The  degree  to  which  these  guidelines  are  transferable 
to  videodisc  development  is  not  altogether  clear,  although 
great  disparity  would  not  be  expected.  This  experiment  was 
designed  to  test  the  application  to  videodisc  instruction  of 
training  guidelines  developed  for  traditional  .methods  cf 
instruction.  The  first  guideline  in  question  was  the 
relative  merit,  in  terms  of  accuracy  and  speed,  of  realistic 
photographic  versus  line  drawing  instruction.  The  second 
question  concerned  the  value  of  learner  instruction  prior  to 
use  of  training  material  as  a  job  performance  aid  versus  use 
of  the  material  as  a  job  aid  without  prior  instruction. 

The  traditional  dependent  variables  for  comparing 
the  effectiveness  of  photographic  vs.  line  drawing 
instruction  have  been  scores  on  verbal  knowledge  of  pictures 
or  measures  of  discrimination  of  parts  of  pictures  presented 
on  visual /verbal  multiple  choice  tests.  The  traditional 
dependent  measure  of  speed  for  these  has  been  time  tc 
complete  a  criterion  task,  again  usually  some  kind  of 
visual/  verbal  test.  For  instance,  research  by  Borg  and 
Shuller  (1979)  and  Markham  (1979)  concerning  learner 
identification  of  tanks  after  pictorial  or  line-  drawing 
instruction,  as  wTell  as  pertinent  research  summarized  by 
Dwyer  (1978),  indicates  that  line-drawing  instruction  and 
photographic  instruction  are  equally  accurate  and  efficient 
when  learning  is  measured  by  scores  on  multiple  choice  or 
identification  tests. 

However,  for  all  the  information  in  the  studies, 
they  do  not  address  these  related  questions:  1)  Do  line 
drawings  and  photographs  yield  equivalent  visual ''verbal  test 
performance  in  videodisc  instruction  as  they  seem,  tc  in 
paper  based  instruction,  2)  Does  one  picture  type  yield 
faster  and  or  more  accurate  performance  than  the  other  for  a 
psychomotor  task  as  opposed  to  visual  verbal  multiple  choice 
test  performance,  3)  Dc.es  prior  instruction  improve  task 
and  or  test  performance  speed  and  accuracy  sufficiently  tc 
warrant  its  use  ir.  a  mechanical  procedural  training 
environment,  and  4)  How  well  does  learning  from,  one  picture 
type  transfer  to  the  alternate  type  cf  multiple  choice  test? 
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METHOD 


Sarnie .  Sixty  students  from  Orer.  High  School  (Orem,  IT) 
cor.prisei  the  sarnie  for  this  experiment.  Subject  ages  were 
distributed  as  follows:  two  (3%)  were  14  years  old, 

eighteen  (30%)  were  15,  twenty-nine  (48%)  were  16,  ei 
(13%)  were  17,  and  three  (6%)  were  18.  Sex  was  distribu 
thus:  fifty-one  (85%)  were  male,  nine  (15%)  were  female. 

The  students  were  chosen  at  rancor,  from  the  school 
population,  but  par t i c ipao ion  was  voluntary:  each  student 
was  asked,  not  required,  to  participate  in  a  military 
training  experiment  involving  videodisc  technology.  There 
was  no  incentive  offered  to  attract  participants  except  the 
opportunity  tc  be  excused  from,  class,  so  personal  interest 
was  a  factor  in  subject  participation. 

Apparatus.  There  were  three  stations  run  by  two  observers 
during  the  experiment.  Each  was  located  in  a  private  study 
carrel  at  the  rear  of  the  Media  Center.  At  each  station  was 
a  television  monitor,  a  videodisc  player,  a  videodisc,  and  a 
box  cf  oartiallv  assembled  cable  acaoters. 

Two  types  of  monitors  were  used  in  the  experiment. 
At  two  stations  were  Sony  model  CVM-1250  Trinitron  color 
receiver  'monitors ;  at  the  other  station  was  a  Panasonic 
CV-1310V  Color  Pilot  color  receiver  .'monitor ;  both  had  nine 
inch  screens. 

A  Magnavox  model  VH3000CHC1  videodisc  player  was 
used  at  each  station.  The  players  were  connected  tc  the 
monitors  via  the  video  output  jack. 

In  each  player  was  a  Sony  videodisc  made  from.  a 
KI  CAT  video  tape  of  U.S.  Army  Training  Manual 

TM11-5995-208-24&P*,  in  which  assembly  of  coaxial  cable 
adapter  CX-10734/G  is  documented  » in  thirty-eight  steps. 
Five  combinations  of  pictorial,  visual,  and  auditory  stimuli 
were  represented  on  the  disc,  so  the  actual  technical  manual 
content  was  reproduced  five  tim.es.  The  two  combinations 
used  as  treatm.er.ts  in  the  experiment  were  1)  silent  still 
frames  with  full  color  photographic  visuals  and  text 
explanations  developed  at  V.TCAT  and  2)  silent  still  fra  res 
with  two  color  line  drawing  visuals  and  text  explanations 
which  were  direct  copies  of  the  technical  manual  pages.  The 
information  contained  in  the  photographic  visuals  was 
designed  to  be  virtually  identical  to  that  cf  tre 
line-drawing  visuals. 

There  was  alsc  a  visual  'verbal  multiple  choice  ter. 
or.  the  videodisc  consisting  of  fifteen  pictures  selectee 
from  the  instruction  to  represent  its  domain,  each  with  a 
Question  substituted  for  the  text  explanation  at  the  rotter. 


if) 


There  were  three  types  of  questions  asked  in  the  test:  1) 
what  step  preceeds  the  step  shown  in  this  picture?  2)  what 
step  follows  the  step  shown  in  this  picture?  and  3)  what  is 
missing  in  this  picture  for  it  to  be  complete?  Four 
alternative  answers  to  each  question  were  printed  on  a 
separate  answer  sheet.  The  test  was  reproduced  twice,  once 
with  photographs  and  once  with  line  drawings. 

The  remaining  equipment  at  each  station  was  a  aroup 
of  four  conmuni  cat  ion  cable  adapters,  each  in  a  different 
stage  of  assembly,  which  constituted  the  four  tasks  of  the 
performance  test.  With  each  cable  was  a  bag  of  parts  which 
subjects  were  expected  to  correctly  assemble. 

Experimental  Des i gn .  To  answer  the  four  questions  listed  at 
the  end  of  the  introduction,  twc  sub-exoer  imer.ts  were 
performed.  The  first  three  questions  were  investigated  bv  a 
2X2  factorial  design  (see  Figure  A-l ) .  Experiment  1 
involved  the  factors  of  picture  type  and  instruction  time, 
with  the  following  levels:  photographs  and  1  ine-drawincs 
for  picture  type,  two  minutes  and  twenty  minutes  for 
instruction  time.  In  the  job  aid  condition  two  minutes  were 
allowed  for  the  subject  to  quickly  become  familiar  with  the 
layout  of  the  material.  Twenty  minutes  were  allowed  for  the 
instruction  condition. 

The  dependent  variables  measured  in  each  cell  of 
this  experiment  were  visual ''verbal  multiple  choice  test 
scores  and  performance  test  scores.  Twc  scores  were 
obtained  for  each  test.  The  first  was  an  accuracy  score 
expressed  in  raw  number  of  correct  items.  The  maximum 
possible  on  the  written  multiple  choice  test  was  15;  the 
tasks  in  the  performance  test  contained  19  steps.  The 
second  score  was  a  speed  score  expressed  in  decimal  minutes 
to  complete  each  test.  It  should  be  noted  that,  though 
there  was  necessarily  some  communication  between  subject  and 
observer  during  the  performance  test,  only  actual  task 
performance  was  timed. 

To  answer  question  four,  another  2X2  factorial 
design  was  created,  with  photographic  visuals  and  line 
drawings  instruction  as  the  levels  of  the  first  factor  and 
photographs  and  line  drawinos  test  as  the  levels  of  the 
second  factor.  Figure  A -2  presents  the  design,  hereafter 
known  as  Experiment  2.  The  dependent  variables  were 
achievement  and  test  tire  on  the  verbal  /  visual  multiple 
choi ce . 

Procedure.  Sur jeers  were  seated  at  a  station  approximately 
twenty  inches  in  front  of  the  monitor  and  within  easy  reach 
of  the  videodisc  control  buttons.  They  were  then  told  that 
the  general  purpose  of  the  experiment  was  to  see  how  well 
the  videodisc  player  could  be  operated  in  an  environment 
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FIGURE  .4- L  2x2  factorial 
design  o*  Experirent  One. 
speed  and  accuracy  measures 
for  vi sual /verbal  and 
psvcficmotor  tests  taken. 


FIGURE  4-2. 2x2  factorial 
design  of  Experiment  Two. 
speed  and  accuracy  measures 
for  only  vi sual /verbal  test 
taken . 
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traditionally  reserved  for  books. 

Subjects  who  were  to  receive  only  two  minutes  of 
instruction  before  beginning  the  tests  were  told  that  they 
were  to  take  two  minutes  to  familiarize  themselves  with  the 
general  format  of  a  lesson  on  the  videodisc  which  showed  the 
steps  to  assemble  a  military  communications  cable  adapter. 
They  were  told  that  they  were  not  to  memorize  the 
instruction  but  were  to  use  it  as  a  cookbook  or  maintenance 
manual,  referring  to  it  as  often  as  necessary  for  correct 
performance.  Subjects  were  shown  how  to  operate  the  player, 
given  a  short  time  to  experiment  with  it,  and  then  began 
their  two  minute  perusal  of  the  instruction. 

Subjects  who  were  to  receive  twenty  minutes  of 
instruction  before  beginning  the  tests  were  given  the  same 
instructions  as  these  who  were  to  receive  only  two  minutes, 
with  the  obvious  exception  that  they  were  told  to  take  as 
long  as  they  wanted,  up  to  twenty  minutes,  to  study  the 
instruction.  Subjects  receiving  twenty  minute  instruction 
were  allowed,  like  those  receiving  two  minute  instruction, 
to  refer  back  to  the  content  during  the  tests.  There  was 
considerably  more  variation  in  the  actual  study  time  used  by 
subjects  at  this  level  of  instruction  time,  some  taking  as 
few  as  nine  minutes  and  others  taking  twenty.  Study  time 
for  each  subject  at  this  level  was  recorded  to  the  nearest 
.01  minute. 

The  visual /'verbal  multiple  choice  test  was 
administered  first,  followed  by  the  performance  test.  The 
performance  test  was  placed  second  because,  since  it  was 
deemed  to  be  the  harder  of  the  two  tests,  it  was  thought  to 
be  to  the  subjects'  advantage  to  have  maximum,  exposure  to 
the  content  before  they  took  it.  All  subjects  were 
administered  the  tests  in  the  following  way. 

Subjects,  still  seated  one  to  a  station,  were  given 
an  answer  sheet  and  directed  to  write  their  name,  age,  sex, 
and  grade  in  school,  and  the  date  in  the  spaces  provided  at 
the  top.  They  then  were  shown  where  on  the  disc  the 
visual /verba  1  multiple  choice  test  began,  and  were  directed 
to  write  down  the  frame  number.  They  were  then  shown  the 
relation  between  the  answer  sheet  and  the  questions  on  the 
monitor,  how  to  get  from  question  to  question,  and  how  to 
get  from  the  test  to  the  instruction  and  back  again.  They 
were  given  a  short  time  to  experiment  with  these  disc 
manipulations,  then  were  placed  at  the  first  question  and 
told  that,  though  they  would  be  timed,  they  should  not  hurry 
but  answer  each  question  correctly;  then  they  were  told  tc 
begin  the  test.  Tiring  began  at  this  point  as  well.  During 
the  test,  subjects  were  left  alone,  only  communicating  witr. 
the  observer  at  their  request. 


A  -  o 


When  the  first  test  was  completed,  subjects  were 
given  no  fee  back  concerning  it,  but  were  imrr.e  d  i  at  e  lv 
introduced  to  the  performance  test.  They  were  told  that 
they  would  now  further  assemble  four  partially  assembled 
cable  adapters,  r  id  that  they  were  free,  as  on  the  first 
test,  to  refer  to  the  instruction  when  they  desired.  After 
this,  subjects  were  given  each  cable  with  its  bag  of  parts 
one  at  a  time  and  asked  to  assemble  each  correctly.  The 
tasks  were  given  in  the' order  in  which  the  related  content 
appears  in  the  instruction,  the  first  task  corresponding  to 
content  early  in  the  instruction  and  the  fourth  task 
corresponding  to  content  toward  the  lesson's  end.  The 
following  description  of  subject  performance  evaluation 
applies  to  all  four  tasks. 

When  subjects  made  some  purposeful  movement,  such  as 
pressing  a  videodisc  control  button  or  picking  up  a  cable 
adapter  component,  the  observer  began  timing.  The  observer 
used  an  observation  sheet  printed  with  the  steps  in  each 
task  to  record  whether  or  not  each  step  was  correctly 
performed.  The  criterion  for  success  on  a  given  step  was 
not  that  it  be  done  in  some  particular  order  but  simply 
that,  when  the  student  was  finished  assembling  the  adapter, 
it  be  correctly  assembled.  Timing  ended  when  subjects 
indicated  that  they  were  done  by  holding  up  the  adapter  for 
the  observer's  inspection  or  by  verbally  indicating  that 
they  were  finished.  If  subjects  who  had  not  attempted  the 
last  step  of  a  task  asked  whether  they  were  finished,  they 
were  told  no.  However,  if  subjects  who  had  attempted  the 
step  but  had  done  it  incorrectly  asked  the  same  question, 
they  were  told  yes  and  the  last  step  in  the  task  was  narked 
wrong . 

When  both  tests  were  completed,  subjects  were  asked, 
"How  hard  did  you  try  on  these  tests?"  Subjects  responded  by 
indicating  a  location  on  a  five  point  scale,  five  meaning 
"very  hard"  and  one  meaning  "not  at  all." 


RESULTS 

The  data  was  analyzed  using  a  two-way  analysis  of 
variance.  In  order  to  take  the  unequal  cell  sizes  (shown  ir. 
figures  A-l  and  A-2)  into  account  in  the  analysis,  ar. 
adjusted  ANOYA  rather  than  a  sequential  ANOYA  was  used.  The 
model  used  for  experiment  one  was 

Y ( i j )  =  A ( i )  +  B ( j )  +  AB(ij)  +  e 

where  factor  A.  was  picture  type  and  factor  B  was  instruction 
tim.e,  both  factors  beina  fixed.  The  model  for  experiment 
t  W  O  W  h  S 


Y(i  j) 


(i  )  +  I  (  j  )  +  T I  (  i  j  )  +  e 


where  factor  T  was  test  picture  type  and  factor  I  was 
instruction  picture  type.  Again,  both  factors  were  fixed. 
Alpha  was  set  at  .05  for  both  experiments.  Each  experiment 
will  be  discussed  in  further  detail  below. 

Experiment  One.  Tables  A-l  and  A-2  present  means  and 
standard  deviations  for  the  factors  of  interest.  Table  A-3 
presents  the  Analysis  of  Variance  results.  The  results  of 
this  experiment  shed  some  light  on  questions  one  through 
three  (listed  at  the  end  of  the  introduction).  Generally 
speaking,  picture  type  seemed  to  have  no  effect  on  either 
performance  speed  or  accuracy.  This  was  true  of  both  the 
multiple  choice  test  and  the  psychomotor  test,  although 
there  was  an  exception  which  will  be  discussed  below.  Prior 
instruction  seemed  to  affect  visual/verbal  test  performance 
time,  but  accuracy  scores  remained  roughly  equivalent  across 
both  levels  of  this  factor.  There  was  evidently  no  effect 
on  either  speed  or  accuracy  of  psychomotor  per  form, ance .  The 
statistics  supporting  these  generalizations  are  given  below. 

Picture  type  had  no  effect  on  speed  or  accuracy  in 
either  criterion  task.  The  F-value  from  the  test  of  effect 
of  picture  type  on  visual  ./verbal  test  speed  was  0.03, 
nor.-signif icant  when  compared  to  the  table  value  of  4.04  (df 
1,56).  The  F-value  from  the  same  test  applied  to 
visual /verba  1  accuracy  was  also  non-significant:  0.19.  The 
F-value  from  the  test  of  effect  of  picture  type  (factor  A  in 
the  model)  on  psychomotor  performance  speed  was  0.39,  well 
below  the  table  value  of  4.08  indicated  by  the  degrees  of 
freedom  (df  1,45).  The  F-value  from  this  test  on 
psychomotor  performance  accuracy  was  1.14,  again  w^ell  below 
this  rejection  region.  Thus  there  was  no  apparant  effect  on 
either  dimension  of  visual/verbal  or  psychomotor  performance 
by  picture  type. 

There  was,  however,  an  exception  to  these  findings. 
This  exception  was  a  significant  interaction  between  the 
factors  on  the  speed  measure.  An  F-value  of  4.94  was  found 
for  a  table  value  of  4.08.  Subjects  who  received  twenty 
minute  instruction  and  line-drawings  completed  the 
psyc'nomotor  test  more  quickly  than  subjects  in  any  of  the 
other  three  cells.  The  next  fastest  time  was  for  two  minute 
instruction  with  photographs:  the  cell  combining  twenty 
minute  instruction  with  photographs  was  virtually  equal  to 
the  cell  combining  two  minute  instruction  and  line-drawings. 
Figure  A-3  presents  the  interaction  graphically. 

The  presence  or  absence  of  prior  instruction 
affected  neither  speed  nor  accuracy  in  psychomotor 
performance,  nor  did  it  affect  accuracy  of  performance  on 
the  visual ^verbal  test.  The  F-values  for  effect  of  prior 
instruction  on  psychomotor  speed  and  accuracy  were  0.43  and 
0.25  respectively,  and  both  were  below  the  table  value  of 
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Tabic  A-l 

MEANS  AND  STANDARD  DEVIATION  FOR  SPEED  AND  ACCURACY  OF 
VI SEAL/ VERBAL  AND  PSYCHOMOTOR  PERFORMANCE 
IN  EXPERIMENT  ONE 


FACTOR  A 
PICTURE  TYPE 
1  PHOTO  'I  LIN E 

X  !  SD]  X  T“ 
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Table  A -2 

INTERACTION'  MEANS  AND  STANDARD  DEVIATION  FOR  SPEED  AND 
ACCURACY  OF  VISUAL /VERBAL  AND  PSYCHOMOTOR  PERFORMANCE 

IN  EXPERIMENT  ONE 


'10.36  1  3  .  1 1 
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Table  A- 3 


ADJUSTED  TWO  KAY-ANOVA  TABLES  FOR  SPEED  AND  ACCURACY 
OF  VISUAL/VERBAL  AND  PSYCHOMOTOR  PERFORMANCE 
IN  EXPERIMENT  ONE 


SOURCE 

df 

!  MS 

F 

Visual / 

Picture  Type 

1 

2.52 

0.03 

Verbal 

Instruction  Time 

1 

676 . 15 

9.00* 

Test 

Interact  ion 

1 

29.05 

0.38 

Speed 

Error 

56 

1  75.11 

j 

Visual/ 

Picture  Type 

1 

!  1.5] 

0.19 

Verbal 

Instruction  Time 

1 

0.20 

0.02 

Test 

Interact  ion 

1 

4.27 

0.54 

Accuracy 

Error 

56 

7.87 

Psycho- 

Picture  Type 

1 

19.58 

0.39 

Motor 

Instruction  Time 

1 

21 . 35 

0.43 

!  Interaction 

!  1  1 

244.90 

4.93* 

Speed 

Error 

45 

49.58 

j 

Psycho- 

Picture  Type 

1 

1 

1  j 

8.30 

1  .  14 

Motor 

Instruction  Time  i 

1  J 

1 . 81 

0 . 24 

Accuracy 

Interaction  < 

1  1 

19.78 

2.72 

Error 

45  1 

7.26 

4.08  (df  1,45)  in  both  cases.  The  F-value  for  this  same 
effect  on  visual ^verbal  accuracy  was  0.026,  which  was  also 
under  the  table  value  of  4.04  (df  1,56). 

Conversely,  there  was  a  significant  F-value  found 
for  the  test  of  effect  of  prior  instruction  on  visual /verba  1 
performance  speed.  The  table  value  was  4.08,  as  explained 
above,  and  the  F-statistic  was  9.00.  As  might  be  expected, 
subjects  receiving  twenty  minutes  of  instruction  took  less 
time  than  those  receiving  only  two.  However,  there  is  an 
interesting  corollary  to  this: 

Another  F-test  was  performed  on  the  time  it  took 
subjects  to  complete  both  instruction  and  test  in  each  of 
the  two  cells.  Again  the  F-value  was  significant  (13.087 
compared  to  a  table  value  of  4.04),  but  in  the  opposite 
direction.  Considering  instruction  time  as  well  as  test 
time,  subjects  receiving  twenty  minutes  of  instruction  took 
longer  than  those  receiving  only  tw’o.  This  result  is 
particularly  noteworthy  in  light  of  the  report  above  that 
there  was  no  difference  in  accuracy  between  the  cells. 
Further  analysis  of  the  data  revealed  an  important  result  in 
the  affective  domain: 

Tables  A-4  and  A-5  present  the  means  and 
significance  test  results  for  the  data  on  ratings  of  task 
difficulty.  The  mean  perception  of  task  difficulty  for 
students  receiving  twenty  minute  instruction  was  compared  to 
the  sam.e  mean  for  students  receiving  two  minute  instruction, 
and  an  F-value  of  4.374  was  found  (the  table  value  was  again 
4.04).  Subjects  who  received  two  minute  instruction,  though 
they  performed  as  accurately  as  their  twenty  minute 
counterparts  on  the  visual /  verbal  test  and  as  accurately 
and  quickly  on  the  psvchomotor  test,  nevertheless  rated 
their  total  experience  as  more  difficult. 

Experiment  Two.  The  research  question  for  this  experiment 
was  to  test  the  interaction  of  instruction  picture  type 
(pictures  or  line  drawings)  and  test  picture  type  (pictures 
or  line  drawings)  As  noted  in  the  experimental  design 
section,  the  dependent  variables  of  achievement  and  tim.e 
were  studied  in  this  experiment. 

Table  A-6  presents  the  means  for  Experiment  Two, 
while  Table  A-7  presents  the  significance  test  results.  The 
statistics  of  interest  in  this  experiment  were  those  testing 
the  interact  ions  between  factors.  All  other  tests  simply 
duplicated  those  performed  on  factor  A  in  experiment  cr.e : 
tests  on  the  interactions,  on  the  other  hand,  checked  the 
learning  transfer  from  one  level  of  instruction  tc  the 
opposite  level  of  test. 


Table  a-4 


i  C/J  ill 


SOURCE 


Speed 

i  Instruction 
i  T es  t 

i  Interact  ior. 

-  Error 

Accuracy 

i  Instruction 

j  Test 

1  Interaction 

The  interaction  between  factors  on  the  accuracy 
Treasure  yielded  a  non-s  i  gn  i  f  i  cant  F-value  of  0.04,  the  table 
value  being  4.04  (dft=l,  df e~56 ) .  Mcwever,  the  interaction 
on  the  speed  m  'a  sure  was  a  si  ir.:fi  '  c.t  11.12.  Subjects  who 
received  one  picture  type  in  their  instruction  an:  the  other 
in  their  test  took  longer  to  cc. -plate  the  test  than  these 
who  received  the  sane  picture  type  in  both.  Tables  A-6 
I  *  presents  the  means  and  standard  deviations  for  this 

interaction.  Figure  A- 4  presents  the  interaction 
graph ica 1 ly . 


PI  SCVSSI  ON' 


Interpretation  of  the  results  described  above  will 
be  none  a  function  of  the  psychomotor  test  findings  than  of 
rhe  visual  verbal  test  findings.  This  is  because  the  type 
of  training  which  the  videodisc  lesson  used  in  the 
experiments  typifies,  is  that  associated  with  mechanical./ 
procedural  tasks.  All  conclusions  in  this  section  should  be 
read  with  that  in  mind.  Findings  of  each  experiment  will  be 
interpreted  separately  below. 

Experiment  One.  The  questions  to  be  answered  here  were, 
again, 

(1)  Line  drawings  and  photographs  are  equally 

instructive  in  paper  based  training  when  learning 
is  measured  by  visual /verbal  tests;  are  they  equal 
according  to  this  criterion  in  videodisc  training 
as  well? 

(2)  Are  line  drawings  and  photographs  equally 

instructive  (in  videodisc  training)  when  learning 
is  measured  by  psychomotor  tests? 

(3)  Does  videodisc  instructio'n  prior  to  task 
performance  improve  learning,  in  comparison  to  a 
job  aid,  sufficiently  to  warrant  its  use  in  the 
mechanical/procedural  training  environment? 

The  results  above  indicated  that  the  answer  tc 
question  one  is  "yes,  photographs  and  line-drawings  are 
equally  instructive  in  videodisc  training  when  learning  is 
self-paced  and  measured  by  a  vi sual /verbal  test.”  This  means 
that  line  drawings  and  photoaraphs  are  equally  powerful  in. 
videodisc  instruction,  as  well  as  in  paper  baser 
instruction.,  when  learning  is  measured  by  visual  /venial 
tests. 


Question  two  can  be  answered  similarly.  The  lack  of 
statistical  difference  between  speed  or  accuracy  psychomotor 
scores  of  subjects  receiving  photographic  instruction  ana 
those  of  subjects  receiving  line-drawing  instruction  implies 
that  photographs  have  no  more  effect  on  psychomotor  learning 
than  do  line  drawings. 

Question  three  is  less  clear-cut.  On  the  one  hand, 
subjects  receiving  twenty  minute  instruction  completed  the 
visual /verbal  tests  more  quickly  than  those  receiving  two 
minutes.  On  the  other  hand,  however,  subjects  receiving  two 
minutes  of  instruction  took  less  time  overall  than  their 
twenty  minute  counterparts.  If  this  were  all  the  relevant 
information  in  the  experiment,  a  case  could  be  made  for 
eliminating  instruction  on  the  basis  of  cost-  effectiveness: 
two-minute  subjects  performed  as  accurately  as  twenty-minute 
subjects,  and  did  it  faster  overall. 

However,  there  is  more  to  consider.  Subjects  who 
received  twenty  minutes  of  instruction  felt  more  comfortable 
with  the  tasks  than  these  who  received  only  two  minutes. 
Also,  picture  type,  just  dismissed  as  of  insignificant 
effect,  surprisingly  contributes  to  a  signi  f car.t 
interaction  of  instruction  time  on  speed  of  psychomotor  test 
completion.  Each  of  these  observations  is  discussed 
separately  below. 

Subjects  receiving  twenty  minutes  of  instruction  did 
indeed  report  significantly  more  ease  in  task  completion 
than  those  who  received  two  minutes.  However,  the  size  cf 
the  difference  is  only  6%  of  the  possible  range  of  opinion. 
In  other  words,  twenty-minute  subjects  felt  they  had, 
col lectively,  tried  a  little  less  than  "hard"  (3.6  on  a 
scale  of  5)  and  two-minute  subjects  felt  they  had,  on  the 
whole,  tried  a  little  more  than  "hard"  (4.1  on  a  scale  of 
5).  Thus,  while  the  difference  shown  is  probably  extant  in 
the  population  of  which  the  subjects  were  a  sample,  it 
likely  is  of  little  practical  importance. 

This  argument  cannot  be  used  on  the  interaction 
though ;  the  difference  between  its  maximum  and  minimum, 
means  is  as  great  as  any  in  the  experiment.  Discussion  with 
the  observers  who  actually  collected  the  data,  however, 
prompted  this  relevant  remembrance:  over  half  the  subjects 
had,  after  completing  the  experiment,  briefly  viewed  the 
treatment  they  did  not  receive,  and  a  number  had  commented 
that,  although  the  photographs  were  "realistic,"  the 
1  ir.e-drawings  were  "clearer."  The  observers  took  this  tc 
rear,  that  the  line-  drawings  had  more  information  in  the- 
than  the  photographs. 

Review  of  the  lessons  revealed  that  there  were, 
indeed,  two  reoogni z earl e  differences  in  message  design,  if 
not  in  content:  a)  the  line-  drawings  had  arrows  or  other 
symbols  which  were  missing  in  the  photographs,  to  indicate 


i  • 


the  love ment  .f  a  part  being  placed  onto 
and  b)  the  line-  drawings  contained 
missing  in  the  photographs,  of  parts  too 
in  detail  at  the  scale  of  the  rest  of 
that  the  NTSC  standard  resolution  of  the 
allow  the  photographs  any  more  accuracy 
The  photographs  however,  provided  a  better  picture  of  the 
relative  size  and  position  of  the  components  than  did  the 
drawinas . 


the  cable  adapter; 
enlargements,  again 
small  to  be  drawn 
the  picture.  (Note 
TV  monitors  did  not 
than  the  drawinas). 


These  aspects  of  the  line  drawin  .:  could  have  caused 
confusion  in  subjects'  minds  when  they  were  confronted  with 
drawings  criss-crossed  with  arrows  and  lir.es  and  partially 
covered  with  enlargements.  This  may  have  been  a  factor  in 
the  slower  speed  of  psycnomotor  test  completion  by  subjects 
with  two  minute  instruction.  Conversely,  these  same  aspects 
could  have  clarified  the  information  to  students  receiving 
twenty  minute  instruction,  since  there  was  more  information 
represented  per  picture  and  the  subjects  could  process  it 
relatively  at  their  leisure. 

This  idea,  along  with  the  lack  of  evidence  elsewhere 
in  the  results  supporting  other  hypotheses,  suggests  that 
the  interaction  nay  have  been  an  artifact  of  the  materials 
rather  than  a  bona  fide  characteristic  of  the  independent 
variables . 

With  all  this  in  mind,  there  is  some  evidence  that, 
in  a  mechanical/procedural  training  environment,  guiding 
trainees  through  the  actual  procedures  by  use  of  the 
videodisc  may  be  just  as  effective  as  and  more  efficient 
than  giving  them  a  long  period  of  instruction  before  letting 
them  get  their  hands  on  the  equipment. 


Experiment  Two.  The  question  here  was  whether  learning  from 
one  picture  type  will  transfer  to  a  visual/verbal  test  of 
the  other  type  as  well  as  to  one  of  the  same  type.  The 
answer  is  straightforward:  while  accuracy  was  not  affected, 


speed  was.  Tests  of  the 
completed  more  quickly 
Thus  the  conclusion  from 
training  material  should 
used  in  the  test. 


instruction  were 


same  type  as  the 
than  those  o 
experiment  two 
be  of  the  same  picture  type  as  that 


*  the  opposite  type, 
is  that  pictorial 


APPENDIX  B 


THE  LEGIBILITY  OF  LINE  DRAWINGS  AND  ALP:’ ANUMER1 GS 
ON  NTSC  STANDARD  TELEVISION 

EXPERIMENT  III 


This  section  reports  an  experirent  perforr.ee  to 
define  the  size  of  visual  reduction  at  which  line  drawings, 
numbers,  and  print  typical  of  military  training  material 
become  illegible  when  displayed  on  NTSC  standard  color  TV. 
These  experiments  were  performed  as  part  of  research  aimed 
at  recommending  to  the  A.rmv  Communicative  Technology  Office 
optimum.  speci  f  i  ca  t  ions  for  electronic  presentation  of 
training  and  maintenance  material. 

The  first  component  was  designed  to  define  the  sizes 
at  which  actual  performance  was  best.  The  second  component 
was  designed  to  define  the  sizes  which  were  preferred.  Five 
sizes  of  line  drawings  and  five  corresponding  sizes  of  text 
were  presented.  The  smaller  drawings  and  text  were  expected 
to  yield  both  poorer  performance  data  and  poorer  preference 
data  since  small  characters  do  not  resolve  as  well  as  large 
ones.  The  real  question  therefore  was  this:  Specifically 
which  change  in  size  results  in  unacceptable  video 
presentation  of  material? 


METHOD 

The  procedures  differed  for  each  component,  so  each 
will  be  described  separately;  however,  subjects  and 
apparatus  were  identical  for  the  experiments  and  hence  will 
be  described  together.  Size  and  type  of  graphic  were  the 
independent  variables  of  interest.  The  dependent  variables 
were  proportion  correct  and  legibility  ratings. 

Subjects.  Two  groups  of  subjects  participated  in  the  study: 
Forty  Brigham.  Young  University  (Provo,  Utah)  students 
solicited  by  classroom,  announcement  or  public  advertisement 
and  remunerated  with  a  movie  theater  pass  comprised  one 
sample;  seven  members  of  the  Pleasant  Grove  (Utah) 
Petroleum.  Pipelines  unit  of  the  Army  Reserve  who  were  asked 
to  participate  by  their  C.O.  comprised  the  other  sample. 

In  the  BYT  group,  28  (70*)  of  the  participants  were 
male;  of  those,  26  (93*  of  the  males,  65*  of  the  sample' 
were  students  between  the  ages  of  eighteen  and  twenty- f i vc 
and  2  (5%  of  the  males)  were  faculty  members  between  the 
ages  of  thirty  and  fifty.  One  ycur.g  man  was  French  and  one 
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was  Pakistani.  All  twelve  female  participants  (30?  of  the 
sample)  were  students  between  eighteen  and  twenty-five  years 
old.  None  of  their  were  non-native. 

In  the  Army  Reserve  group,  five  (71?)  of  the  seven 
participants  were  male;  all  of  them  were  between  thirty  and 
fifty  years  old.  Of  the  two  female  participants  (29?  of  the 
sample)  one  was  in  the  age  category  of  eighteen  to 
twenty-five  years  old  and  the  other  was  in  the  age  category 
of  thirty  to  fifty  years  old.  None  of  the  Reservists  was 
non-nat i ve . 

Apparatus.  The  drawings  and  text  were  recorded  on  an 
optical  videodisc  mastered  from,  a  1  inch  video  tape  produced 
by  WI  CAT .  The  disc  was  played  on  a  Disrovisior:  Model 
PR-7820  videodisc  player.  The  player  was  connected  via  its 
video  output  jack  to  a  model  CVM-1250  Sony  Trinitron  color 
receiver  ’monitor .  This  system,  operates  on  the  NTSC  standard 
of  525  raster  scan  lines  with  a  2:1  interlace  refresh 
pattern  at  a  bandwidth  of  4.26  megahertz;  it  yields  a 
vertical  resolution  of  225  and  a  horizontal  resolution  of 
350  as  read  from  a  RET’-'A  EIA  resolution  chart.  When 
response  tim.es  were  measured,  a  quartz  chronograph  stopwatch 
was  used. 


Materials.  Seven  types  of  stimuli  were  used  in  the 
experiments:  1)  aircraft  altimeters,  2^  aircra 

horizontal-vertical  situation  indicators,  3)  aircra 
heading  indicators,  4)  voltmeters,  5)  aircraft  cor.tr:! 
panels,  6)  passages  of  text,  and  7)  flowcharts.  For  the 
first  four  types,  subjects  were  asked  to  read  a  number 
indicated  by  the  needle  or  pointer  on  the  instrument. 
Subjects  were  asked  to  rate  the  fifth  type  (control  panels' 
on  the  legibility  of  knob  setting  labels.  For  types  six  and 
seven,  subjects  were  simply  asked  to  read  the  text.  Each  c_f 
these  types  was  presented  at  five  sizes,  chosen  to  present  a 
range  of  legibility  from  easy  to  impossible. 

Size  was  measured  by  height  of  characters  in  TV  scan 
lines.  Table  B-l  presents  the  seven  types  cf  stimulus 
materials  and  five  sizes  of  a  lp'nanumer  i  cs .  Note  that  the 
altimeter  is  larger  than  other  materials  at  each  relative- 
size,  and  that  text  was  also  somewhat  larger.  The  altimeter 
contained  two  distinct  sizes  of  text.  Subjects  were 
explicitly  directed  and  trained  to  rate  the  larger  size,  and 
it  is  this  size  which  appears  i r.  Table  E - 1  . 

Subjects  participated  one  at  a  time.  Each  subject 
was  seated  27  inches  from  the  TV  screen,  but  was  told  t 
move  closer  or  farther  away  as  comfort  dictated.  7:.-. 

subject  was  asked  to  read  four  dials  (stimulus  tyje?  1 
through  4)  at  various  readings  and  sizes.  Before  t h *. 
stimuli  were  presented,  an  exarrle  of  each  dial  at  :ts 


1  h  I  h 


it.  When  the  subject  indicated  confidence  in  reading  each 
dial,  a  randomized  sequence  of  dials  at  various  sizes  and 
readings  was  presented.  The  tine  it  took  the  subject  to 
read  each  dial  was  measured  and  recorded.  Each  answer  was 
recorded  as  correct  or  incorrect  as  well.  This  component 
usually  took  about  five  minutes. 

To  evaluate  subjective  preferences  for  different 
display  sizes,  each  participant  was  shown  all  seven  stimuli 
at  every  size  and  reading.  Stimuli  were  presented  in 
alternating  order  from.  large  to  small  and  then  small  tc 
large.  Subjects  gave  each  picture  a  legibility  rating  on  a 
scale  of  5  to  1,  5  being  readable  but  too  big,  4  beir.c 
ideal,  3  being  readable  but  toe  small,  2  beinc  only 
partially  readable,  and  1  being  unreadable.  Subjects  were 
told  that  a)  they  need  observe  no  particular  order  in  their 
ratings  even  though  the  stimuli  would  be  Dreser.ted  in  lame 
tc  small  order,  and  b)  they  should  rate  each  picture 
according  to  how  well  they  could  read  it  and  not  accordinc 
to  whether  or  not  they  knew  what  it  said  (since  they  always 
saw  the  largest  size  first).  Each  stimulus  was  then 
presented  and  rated.  This  component  usually  took  about  ten 
minutes  for  each  presentation  order. 


RESULTS 

Table  E-2  presents  the  average  response  times  and 
proportion  correct  for  each  display  dial  size  for  each 
sample  population.  This  table  shows  that  response  time  and 
errors  increase  as  the  display  size  decreases.  Display  size 
4  appeared  to  be  optimum  size  for  lower  response  time  and 
fewest  errors. 

Figure  B-l  presents  the  legibility  ratings  for  each 
type  of  material  at  each  size.  The  decrease  in  legibility 
rating  is  basically  linear  for  decreasing  size,  in  the  range 
selected.  Note,  however,  that  the  altimeter  at  15  scar, 
lines  size  receives  only  a  modest  rating,  while  other  types 
of  indicators  at  15  scan  lines  receive  a  very  high  rating. 
This  may  be  due  tc  subjects  rating  the  smaller  text  in  the 
altimeter  graphic.  Table  3-3  presents  the  mean  percent  at 
each  preference  fer  each  size.  A.  sharp  break  occurs  for 
sizes  4  and  5  retween  ratings  cf  "Readable  but  small"  an: 
"Ideal." 


DISCUSSION 

Figure  3-2  presents  an  abstracted  relationship 
between  character  height  in  scan  lines  ar.d  preference 
rating.  This  curve  fits  the  data  rather  well,  ar.  : 
corroborates  related  studies  whirl.  find  that  10  tc  12  TU 
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Table  B-2 

MEAN  RESPONSE  TIME  AND  PROPORTION  CORRECT 
BY  DISPLAY  DIAL  SIZE 


College  (N=40) 


Army  Reserve  (N=7) 


Response  Proportion 

Time  Correct 
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Size 
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1 

2 
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10 . 53 
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10.48 

.  52 

6.49 

.79 

10.42 

.83 
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00 

.94 

B  .35 

.93 

4.71 

.96 

6 . 05 

.92 

4.91 

.87 

7.01 

1.00 

scan  lines  is  an  excellent  choice  for  legibility.  Fiacre 
E-3  presents  a  similar  curve  for  proportion  of  correct 
responses  in  relation  to  character  height.  Note  that  sice 
can  he core  so  large  that  subjects  begin  to  make  more  errors. 


I  n : 


s  research  motivates  some  tentative  cone  1  us i or.s  : 
Text  and  graphic  elements  should  be  measured  in  scan  lines 
and  should  be  at  least  10  lines  in  height.  Materials 
development  should  generally  ensure  that  where  type  sizes 
are  .mixed,  that  all  are  at  least  10  scan  lines  high  and  that 
rarelv  are  very  larae  fonts  (above  14  to  16  scan  lines )  used 


APPENDIX  C 


EXPERIMENT  4 

RESOLUTION  REQUIREMENTS  FOR  TRANSFERRING  PRINTED 
MATERIALS  TO  AN  ELECTRONIC  DELIVERY  SYSTEM 

Electronic  delivery  systems  must  be  capable  of  presenting  a 
wide  variety  of  visual  and  text  displays  which  are  currently 
available  in  paper  text  and  textbook  form.  The  conversion 
of  print  materials  to  electronic  form  may  be  accomplished 
through  photographic  reproduction  or  several  alternative 
reformatting  approaches.  Photographic  reproductions 
requires  a  television  camera,  a  video  storage  system  and 
an  electronic  display  device  (CRT).  Reformatting  of  visuals 
and  text  for  electronic  displays  can  be  done  through  either 
digital  scanning  and  software  reformatting,  or  video 
character  generator  reformatting.  Using  a  video  character 
generator  WICAT  Systems  in  Orem,  Utah  has  demonstrated  the 
feasibility  of  reformatting  lessons  and  courses  from 
technical  manuals  to  electronic  form  for  videodisc  display. 
The  Illinois  Institute  of  Technology  Research  Institute 
has  been  conducting  research  on  digital  scanning  and  soft¬ 
ware  reformatting  of  visual  and  text  information.  Both 
projects  are  supported  by  the  Army  Communicative  Technology 
Office  (ACTO).  Photographic  reproduction  of  visual  and  text 
information  for  use  with  electronic  displays  was  the  focus 
of  the  present  experiment. 

The  study  was  designed  to  identify  the  video  bandwidth  and 
scan  line  rates  necessary  for  effectively  presenting  visual 
and  text  information  following  a  photographic  reproduction 
process.  Current  research  indicates  that  the  visibility 
and  legibility  of  a  CRT  display  is  a  function  of  both  the 
video  bandwidth  signal  and  the  scan  line  rate  (Shurtleff. 
1980:  Snyder,  1980:  Sherr.  1979;  Task,  1979).  Erickson 
(1978),  Snyder  (1974),  and  Shurtleff  (1980)  specifically 
propose  that  the  use  of  medium  and  high  resolution  line 
rates  (greater  than  525  scan  lines)  can  increase  the 
display  image  quality  and  improve  viewer  performances. 

Existing  research  also  shows  that  standard  NTSC  displays  (525 
lines)  have  a  line  rate  resolution  that  is  less  than  or 
equal  to  the  resolution  of  the  printed  page  (Stewart,  1976). 

The  present  study  investigated  the  raster  scan  line  rates 
and  video  bandwidth  settings  which  were  necessary  for 
effective  electronic  display  of  video  and  text  information. 
Three  raster  scan  line  rates  and  five  bandwidth  settings 
were  used. 


Method 

Subjects.  Two  samples  of  subjects  were  used  for  this 
experiment .  The  first  sample  consisted  of  59  students 
and/or  faculty  at  Brigham.  Young  University.  The  first 
sample  included  38  male  and  21  female  subjects  with  an 
average  age  of  22  years.  All  subjects  had  normal  or 
corrected  20/20  vision.  The  second  sample  consisted  of 
12  Army  Reserve  personnel  ’from  the  Pleasan'r  Grove  Army 
Reserve  Unit  in  Utah.  The  second  sample  included  10  male 
and  2  female  subjects.  All  of  these  subjects  had  normal 
or  corrected  20/20  vision. 

Appara t us ,  A  closed-circuit  television  system  was  used 
for  the  study.  The  system  included  a  Cohu  7120  High- 
Resolution  vidicon  camera  and  a  Conrac  QQA  17  /  c  monochrome 
video  monitor.  The  bandwidth  and  scan  line  rate  were 
controlled  from  a  Cohu  7932  High-Resolution  Monochrome 
Television  Camera  Control  Unit.  Scan  line  rates  of  525, 

945  and  1225  lines  were  produced  using  both  camera  and 
monitor  controls. 

Alternative  bandwidth  settings  were  presented  by  inter¬ 
changing  the  components  of  the  Bandpass  Filter  Assembly 
on  the  Video  Processor  circuit  board.  The  experiment 
involved  five  bandwidth  settings,  of  8.  12,  16,  20,  and 
32  MHz.  When  the  bandwidth  filters  and  coils  were  received 
we  contacted  the  manufacturers  to  check  the  codes  for  the 
bandwidth  filters  and  coils.  The  codes  checked  out  for 
all  components  except  for  one  electronic  coil  for  use  with 
the  12  MHz  filter.  The  company  had  no  record  of  the  codes 
used  on  the  coil.  The  coil  was  used  in  the  experiment  as 
though  it  was  the  correct  coil. 

Besides  the  available  lighting  that  each  experimental 
room  provided,  two  floodlamps  with  soft-white,  100  watt 
light  bulbs  were  used  to  produce  an  ambient  light  of  five 
footcandles  at  the  target  surface. 

Stimuli  .  Five  experimental  stimuli  were  selected  from. 


military  training  handbook: 
stimulus  is  giver,  below 


A  brief  dt-scrirtion 


a.  Black  and  white-  photographs  of  a  small  mi  1  it  art- 
weapon  system.'  Suitcase  Sagg'er  Antitank  Guided 
Missile:'  TP. ABOC  Pam.  71-9.  p.  '  3-30-7. 

b.  Page  of  standard  text  Mi 1 -M-3S784A .  p.  37. 

c.  Grav  scale -coded  flow  diagram.  MIU-MLa  IC-63038- 
G  3  . 


d.  Page  of  text  with  alternative  type  fonts:  Preparing 
Text  For  Printing,  MIL-HDBK-6 30 3*8-1 ,  p.  15/20.’ 

e.  Large  Photograph:  Telfare  Device  (Machine  gun  strap 
on  mount);  TRADOC  Pam  71-9,  p.  3-17-15. 

The  TV  camera  was  focused  on  each  stimulus  so  that  the  full 
page  appeared  on  the  TV  monitor.  Because  of  the  ratio  of 
length  to  width  needed  for  presentation  of  8V  x  11"  displays, 
the  monitor  was  placed  on  its  side.  The  standard  3:4 
monitor  aspect  ratio  was  thus  changed  to  a  4  to  3  aspect 
ratio . 


Experimental  Design.  The  subjects  viewed  each  stimulus 
described  above  at  bar.dwidths  of  8,  12,  16,  20,  and  32  MHz; 
and  at  scan  rates  of  525,  945,  and  1225  lines.  The  variables 
of  the  system  were  combined  into  a  5  (bandwidth)  x  3  (scan 
rate)  x  5  (stimulus)  matrix  to  produce  75  different  experi¬ 
mental  conditions  for  each  subject. 


For  the  first  sample,  the  order  of  bandwidth  presentation 
was  randomized,  while  scan  rare  was  not.  The  scan  rate  for 
each  bandwidth  was  incremented  from  525  to  945  to  1225  lines. 
For  the  second  sample,  the  order  of  both  bandwidth  setting 
and  scan  rate  were  randomized  for  each  group  of  subjects. 

The  order  of  presentation  for  the  five  stimuli,  however, 
did  not  vary  for  either  sample.  The  presentation  order  for 
each  stimulus  at  each  setting  was  from  stimulus  (a)  to  stimulus 
(e)  in  descending  order. 

Procedure .  The  subjects  were  seated  in  groups  of  tuTo  in 
front  of  the  TV  monitor  which  rested  on  a  table  directly 
before  them.  The  monitor  was  placed  at  approximately  28  in. 

(70  cm)  viewing  distance  (as  suggested  by  Bean,  in  press). 


Each  group  of  subjects  was  introduced  formally  to  the  system, 
and  briefed  as  to  the  objective  of  the  experiment.  The 
subjects  were  then  shown  the  five  stimuli  to  be  used  during 
the  experiment  and  were  told  to  rate  the  quality  of  the 
reproduced  image  (versus  the  original)  ehch  time  it  appeared 
on  the  TV  monitor.  Subjects  were  asked  to  mark  their  responses 
according  to  the  following  scale: 


7  Excellent.  The  picture  on  the  screen  is  of  the 
same  quality  as  the  original. 


6  Very  good.  The  picture  is  very  clear,  but  not 
quite  as  clear  as  the  original. 

5  Good.  The  picture  quality  has  diminished  somewhat 
but  is  still  more  than  adequate. 


4  Fair.  The  picture  is  of  adequate  quality. 

Poor.  Picture  quality  has  diminished  to  bc-lcw- 
acceotable  standards. 


3 


2 


Very  poor.  The  picture  is  no  longer  fully  legible 
and  is  uncomfortable  to  watch. 

1  Unacceptable.  The  picture  quality  is  not  acceptable 

Subjects  were  next  shown  each  of  the  stimulus  materials  in 
paper  form.  The  subjects  were  told  that  they  should  rate  the 

overall  image  quality  of  each  display  presented  on  the 
television  display. 

In  a  Typical  test  trial,  one  of  the  five  stimuli  would 
appear  on  the  TV  monitor  under  one  bandwidth/scan  rate 
condition.  Each  subject  was  allowed  to  view  the  picture 
as  long  as  necessary  and  would  then  circle  the  imaae 
quality  rating  corresponding  to  that  stimulus  and  that 
setting.  The  experimenter  then  removed  the  picture  from, 
the  monitor,  leaving  a  blank  screen,  and  inserted  the  next 
stimulus.  After  all  five  stimuli  had  been  seen  under  one 
bandwidth /scan  rate  combination,  the  experimenter  changed 
either  the  scan  rate  or  bandwidth  in  accord  with  the 
experimental  design. 

During  the  test  run,  subjects  were  permitted  to  ask 
questions  concerning  the  procedure;  however,  only  those 
questions  whose  answers  were  not  felt  to  prejudice  the 
outcome  of  the  experiment  were  dealt  with  immediately. 


Results 


Descriptive  statistics  and  a  three  way  analysis  of  variance 
were  calculated  for  the  major  factors  of  bandwidth,  scan 
line  rate,  and  research  samples.  For  generalizability 
purposes  all  factors  were  assumed  to  be  random  factors. 

The  dependent  variables  were  the  legibility  ratings  for  the 
five  stimulus  displays,  plus  a  sixth  summed  scale  across 
the  five  displays.  The  RUMMAGE  statistical  package  was 
used  for  analysis  and  an  adjusted  rather  than  sequential 
analysis  of  variance  was  calculated  where  each  term  was 
tested  last  in  the  model  (Scott,  Bryce,  and  Carter,  1980). 

Interaction  plots  of  means  and  F  statistics  were  examined 
for  each  of  the  five  stimulus  displays  and  the  summed 
scale.  The  results  from  the  summed  scale  are  presented 
in  detail  below  and  the  results  from  the  five  stimulus 
displays  are  summarized  to  identify  general  patterns  of 
results.  The  sam.e  general  patterns  of  results  were  found 
on  the  summed  scale  as  on  the  five  subscores. 
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ere  significantly  and  consistently 
945  lines  and  1225  lines.  Second, 
and  32  MHz  bandwidths'  tended  to  be 
for  other  bandwidth  settings, 
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ree  photograph  and  line  drawing 
bility  ratings  than  the  two  text 
s  a  pronounced  drop  in  legibility 
bandwidth  setting. 


Table  C-l  presents  the  means  and  standard  deviations  for  the 
summed  scale;  Table  C-2  presents  the  three  way  analysis 
of  variance  results. 

Table  C-2  shows  significant  effects  for  the  factors  of  bandwidt 
line  rate,  and  subject  group.  Figure  C-l  presents  a  plot  ol 
the  cell  means  for  each  bandwidth  line  rate,  and  subject 
group.  These  plots  show  that  the  525  line  rate  was  less 
legible  than  the  945  and  1225  line  rates.  The  20  and  32 
MHz  bandwidths  were  rated  highest  for  legibility.  The 
reserve  group  ratings  were  generally  higher  at  all  levels 
than  the  college  student  and  faculty  sample.  Table  C-3  provides 
the  analysis  of  variance  table  across  the  five  stimulus 
displays.  This  table  shows  a  significant  effect  for 
stimulus  displays  (F4 (  1064  =  153).  Table  C-4  presents  the 
relevant  means  and  standard  deviations.  This  table  shows 
that  the  photographs  were  judged  as  more  legible  than 
text  pages. 

The  five  stimulus  displays  and  the  summed  scale  also 
showed  a  slight  drop  in  legibility  at  12  MHz.  As 
discussed  above  this  result  may  have  been  due  to  an  out  of 
tolerance  electronic  coil  in  the  12  MHz  bandwidth  filter 
assembly.  There  was  also  a  slight  drop  in  legibility  at 
32  MHz.  Since  the  monitor  was  designed  to  run  up  to  30  Mhz 
the  32  MHz  filter  may  have  been  incompatible  with  the 
30  MHz  monitor  i.’ectronics. 


Discussion 


The  above  results  indicate  that  the  standard  NTSC  525 
scan  line  system  does  not  provide  sufficient  resolution  j 
effective  display  of  full  page  graphics  and  text  from 
technical  manuals.  The  above  result  was  more  pronounced 
for  the  text  pages  than  for  the  pnotographs  and  graphics 
pages.  Photographs  and  graphics  pages  were  rated  much 
higher  at  all  settings  than  were  text  pages.  This  sugaes 
that  text  to  CRT  conversion  would  require  higher  resoluri 
than  visual  graphics  conversion.  A  scan  rate  above  525 
lines  is  needed  for  full  text  page-  to  electronic  raster  s 
di  splay  conversion.  The  945  line  rate  usL-d  in  the  pr-.  s-.  r 
exDeriment  did  orovide  sufficient  text  and  grannies  ima  co¬ 
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Table  C-2 

Adjusted  Analysis  of  Variance 

Table 

SOURCE 

DF  SUV  OF  SQUARES 

MEAN  SQUARES 

F 

Bandwidth  (A) 

4  69.28 

17.32 

15.39 

Line  Rate  (B) 

2  42S.11 

213.06 

190.14 

AB 

8  17.26 

2.16 

1 .92 

Subject  Group 

(C)  1  95.35 

95.34 

S  i  .  7  0 

AC 

4  10.14 

2 . 53 

2 .25 

B  C 

2  2.74 

1  .37 

1  .  22 

ABC 

8  3.23 

0.40 

.  36 

Error 

1035  1165.16 

1.13 

*y<  .05 

Table  C-2 

Analysis  of 

Variance  Across  Stimulus  Displays 

Source 

df  SS 

MS  F 

Stimulus 

4  1560.05  390.01  152. 

98* 

Error 

5320  13562.85 

2.55 

Total 

5324  15122.90 

*  oCCo: 

Table  C-4 

eans  and  Standard  Deviations  for  Stimulus  Displays 

Stimulus  Stimulus  Tyne  X 

SD 

e 

Photograph  4.72 

1 . 50 

a 

Photograph  4.39 

1.49 

c 

Line  Drawing  4.12 

1.65 

d 

Text  3.53 

1 . 7  C 

L 

Text  3.25 

1.62 

The  20  and  32  MHz  bandwidths  were  preferred  across  all 
stimuli  and  the  summed  scale.  The  conclusion  arising 
from  this  study  is  that  a  945  line  rate,  20  MHz  system 
is  capable  of  direct  photographic  page  to  CRT  display 
conversion  for  standard  page  sizes.  Shurtleff  (1980) 
also  recommends  a  high  resolution  (945  lines  or  higher), 

•  high  bandwidth,  and  four  to  three  aspect  ratio  system 

for  presenting  pages  of  text  on  electronic  displays. 

Recent  research  has  been  conducted  on  high  definition  TV 
with  1100  -  1500  scan  lines  using  high  bandwidth  and 
digital  storage  and  retrieval  (Fink,  1980;  Fujio, 

1980;  Sherr,  1979).  These  technological  breakthroughs 
suggest  that  the  medium  and  high  resolution  systems  which 
are  rare  and  costly  today  will  become  more  plentiful 
at  lower  cost  in  the  near  future.  With  high  definition  T 
systems  (either  digital  or  analog)  ,  photographic  conversi 
is  possible  for  changing  of  paper-based  texts  to  electron 
ally  presented  displays. 
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APPENDIX  D 


A  COMPARISON  OF  FOUR  TYPES  OF  USER  INPUT 
FOR  ELECTRONIC  DELIVERY  SYSTEMS 

EXPERIMENT  V 

The  component  of  an  electronic  delivery  system  (EDS) 
which  most  vi s ibly--perhaps  most  power fu 1 ly — a f fects  the 
system's  speed  and  accuracy  of  operation  is  the  instrument 
of  user  input.  The  input  medium,  is  the  crucial  link  between 
the  real  world  and  the  system.  Thus  it  is  crucial  tc  answer 
the  question  of  which  input  medium,  or  media  available  today 
or  in  the  near  future  yields  the  highest  accuracy  an: 
shortest  response  time. 


METHOD 

To  answer  this  question,  WI CAT  tested  subjects 
chosen  for  their  similarity  in  age  and  education  tc  actual 
enlisted  men.  Four  input  media  which  represent  the  present 
state  of  digital  input  technology  were  tested:  1)  a 

standard  ASCII  alphanumeric  keyboard,  2)  a  fifteen  key 
keypad,  3)  a  simulated  touch-sensitive  TV  screen  (hereafter 
referred  to  as  a  touch  panel),  and  4)  a  simulated  voice 
input  system.  In  an  effort  to  approximate  an  actual  Army 
use  situation,  content  typical  of  that  presently  use 

throughout  the  Army  was  the  stimulus  in  the  experiment. 

Finally,  the  experimental  procedure  was  designed  to  assure 
accurate  measurement  of  the  dependent  variables  of  response 
time  and  accuracy  rate.  In  the  following  paragraphs  each  of 
these  components  will  be  described  further. 

Subjects .  Two  samples  of  subjects  participated  in  the 
experiment :  a  sample  of  high  school  students  and  a  sample 

of  Army  ROTC  students.  The  demographi cs  of  each  sample 
differed,  so  each  will  be  described  separately.  Some 
subjects  from,  each  sample  participated  in  each  cell  of  the 

experiment:  this  crossing  of  samples  with  cells  will  be 

reported  as  we 1 1 . 

The  high  school  sample  was  ormained  by  setting  up 

the  experiment  in  the  media  center  of  Orem.  High  School 

(Orem,  UT )  and  recruiting  students  from.  an  advance ' 

placement  biology  class.  Of  the  22  students  wb. ' 
participated,  20  (90s)  were  male  and  2  (10t)  were  female. 

The  average  ace  of  the  sample  was  16.4  years.  There  was  nr 
s  r>er  i  a  i  remuneration  civer.  tc-  the  students:  they  were  clao 
to  re  released  free  class  to  work  with  an  interactive 
videodisc  s v s t e r . 


The  ROTC  sample  was  obtained  by  setting  up  the 
experiment  in  the  text  issue  office  of  the  ROTC  building  at 
Brigham  Young  University  (Provo,  UT )  and  recruiting  students 
who  responded  to  in-class  announcements,  or  to  an 
advertising  poster  in  the  lobby.  Of  the  32  persons  who 
participated,  29  (91%)  of  them  were  male  students,  1  (3%) 
was  a  male  staff  member,  and  2  (6%)  were  female  students. 
The  average  age  of  the  sample  was  23.2  (sd=3.3).  The 
remuneration  promised  to  the  ROTC  subjects  was  simply  the 
chance  to  learn  part  of  the  Call  for  Fire  skills  they  must 
know  to  graduate  from  their  officer  training,  and  to  learn 
in  a  more  engaging  way  than  they  otherwise  might. 

The  samples  were  mixed  in  the  following  way  in  the 
actual  experiment:  In  comparing  the  keyboard  with  the 
keypad,  ROTC  subjects  were  used;  in  comparing  the  touch 
panel  with  the  keypad,  4  ROTC  subjects  and  10  Orem  hick, 
school  subjects  were  used;  in  comparing  the  voice  input 
system  with  the  keypad,  3  ROTC  subjects  and  12  Orem  high 
school  subjects  were  used.  In  each  comparison,  the  subjects 
used  one  method  for  each  half  of  their  learning  time  and  for 
each  half  of  their  test  time. 

Apparatus . The  apparatus  of  the  experiment  was  designed  to 
simulate  one  possible  EDS  conf igurat ion .  Thus,  the  system 
was  a  computer-based,  interactive  videodisc  teaching  system 
The  system,  was  not  one  unit,  but  rather  a  prototype  union  cf 
several  devices:  1)  a  large  mini-computer,  2)  a  telephone 
modem,  3)  a  computer /videodisc  interface,  4)  a  videodisc 
player  (and  disc),  5)  a  TV  monitor,  and  6)  a  modified 
keyboard.  This  system  is  illustrated  in  Figure  D-l,  and 
will  be  described  in  the  following  paragraphs. 

The  computer  used  in  the  experiment  was  a  DEC 
Systems  VAX  11/780.  This  room-size  computer  was  chosen  to 
drive  the  system  not  because  the  proposed  EIDS  w’ould  require 
that  much  memory,  but  because  the  authoring  language  which 
WICAT  was  required  to  use  for  the  content  videodisc  (PLANIT) 
could  net  be  supported  on  a  smaller  system. 

PLANIT  is  the  computer  assisted  instruction  (CAI) 
authoring  language  used  to  develop  the  courseware  which  ran 
the  experimental  system.  It  was  developed  by  System 
Development  Corporation  (Santa  Monica,  CA)  under  a  contract 
to  the  National  Science  Foundation  awarded  in  1966.  The 
A.rm.y  Research  Institute  (ARI)  adopted  it  as  the  language  for 
its  CAI  development  shortly  thereafter. 

P LAX IT  was  used  for  all  courseware  development 
associated  with  another  contract  which  WICAT  conducted  for 
ARI.  The  lesson  materials  from  that  project  were  used  for 
this  experiment.  Thus  WICAT  developed  a  PLAN IT  front  end  tc 
process  videodisc  controller  commands.  We  used  this 
modified  language  in  the  Call  for  Fire  instructional 


development 


Since  the  experiment  was  taken  to  the  subjects 
instead  of  bringing  the  subjects  to  the  experiment ,  the 
equipment  was,  with  one  exception,  portable.  That  exception 
was  the  computer  (described  above).  To  allow  communication 
between  the  computer  and  the  other  components,  a  ConData 
model  302A2-13  telephone  modem  was  used.  It  ran  at  300  Baud 
(a  slow  speed  for  computer  communication). 

The  modem  was  connected  to  the  computer /videod is c 
interface.  The  computer  transmitted  digital  information 
over  the  telephone  through  the  modem,  to  the  interface,  which 
then  sorted  and  transmitted  the  information  to  either  the 
videodisc  player  or  the  monitor  screen  as  appropriate.  The 
interface  had  the  capability  of  mixing  (by  use  of  a  Texas 
Instruments  9918  integrated  circuit  chip)  the  analog  video 
output  of  the  videodisc  player  with  the  digital  video  output 
of  the  graphics  generator  in  the  interface.  They  could  be 
presented  simultaneously  on  the  monitor  screen,  one 
superimposed  on  the  other.  This  resulted  in  substantial 
interweaving  of  the  characteristics  of  normal 
computer-assisted  instruction  (CAI),  such  as  answer 
processing,  multiple  branching,  and  guidance  feedback,  with 
the  television  video  output  and  high  fidelity  stereo  output 
of  the  videodisc.  The  player  itself  was  a  Magnavox 
model  VH8000CH01  videodisc  player  which  had  been  modified  by 
W'lCAT  to  operate  from  the  interface  (as  well  as  from  its 
front  control  buttons).  A  videodisc  on  artillery  Call  For 
Fire  skills  was  presented.  The  disc  was  produced  on  one 
inch  videotape  at  KICAT  and  mastered  and  copied  by  SONY  ir. 
Japan. 


The  TV  monitor  used  in  the  experiment  was  a  Sony 
Trinitron  model  CVM-  1250  color  receiver /monitor .  It  was 
used  in  the  direct  video  monitor  mode.  The  monitor  operated 
at  NTSC  standard  scan  rate,  bandwidth,  and  refresh  pattern. 


The  last  component  of  the  system  was  the  keyboard. 
It  was  made  up  of  two  parts:  a  standard  ASCII  keyboard  and 
a  modified,  16  key  keypad.  Thirteen  of  the  keyboard  keys 
were  used,  each  of  them  interpreted  by  a  symbol  table  in  the 
PLAN IT  front  end  (added  by  WICAT)  to  mean  some  word  or 
phrase  corresponding  to  a  required  response  at  some  point  ir. 
the  experiment.  Each  key  was  labelled  with  its  meaning. 
Even  though  the  experiment  tested  four  input  media,  the  only 
real  input  device  was  the  keyboard:  the  touch  panel  ar.d 
voice  input  were  simulated. 


The  net  result  cf 
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the  content  of  the  subject's  response 


PROCEDURE 

The  experimental  design  dictated  a  procedure  which 
consisted  of  three  parts:  the  assignment  of  participants  to 
a  cell  of  the  treatment,  the  prefatory  explanation  and 
directions  given  to  each  subject,  and  the  actual 
administration  of  the  treatment.  The  experimental  design 
and  each  part  of  the  procedure  emerging  therefrom  will  be 
described  below. 


Experimental  Design.  To  understand  how  subjects  were 
assigned  to  ceils,  the  different  cells  must  first  be 
distinguished  from  one  another.  The  experiment  was  built 
hierarchically,  the  inexpensive  input  media  being  compared 
with  each  other  first,  then  the  "winner  of  the  heat"  being 
compared  to  each  of  the  more  expensive  media  in  order  of 
their  price.  This  was  done  to  give  some  consideration  to 
the  role  price  will  undoubtedly  play  in  the  final  selection 
of  input  medium  for  the  EDS.  A  hypothesis  based  on 
practical  considerations  is  that,  of  the  two  inexpensive 
input  media  (the  keyboard  and  keypad),  the  keypad  would  be 
both  the  faster  and  more  accurate  medium.  Thus,  comparing 
the  two  simulated  input  media  to  the  keyboard  would  be  of 
little  value.  As  a  result,  an  experimental  design  of  three 
cells  was  used  where  the  keypad  was  compared  to  each  of  the 
other  three  media.  Table  D-2  illustrates  the  design. 


Ass i gnmer.t  of  Subjects  to  Cells. _  Also  noted  in  Table  D-l  is 
the  number  or  subjects  per  cell  per  sample.  Note  that  the 
ROTC  sample  fills  the  first  cell  and  the  Orem  high  school 
sample  dominates  the  second  and  third  cells.  This  is  a 
result  of  the  method  of  assigning  subjects  to  cells. 

Subjects  were  assigned  to  cells  predominantly  on  the  basis 

of  when  they  participated  in  the  experiment.  Cell  1  (the 

comparison  of  keyboard  with  keypad)  was  performed  before 

cells  2  and  3.  The  ROTC  staff  offered  the  cooperation  of 

their  students  before  Orem,  high  school  did,  sc  ROTC  students 

became  the  subjects  for  cell  I.  It  is  for  this  same  reason  i 

that  Orem.  High  School  dominates  the  latter  two  cells. 

Prefatory  Instructions  and  Directions^  Subjects  were  taken 
through  the  experiment  one  at  a  time,  with  a  proctor  m 
constant  attendance.  Subjects  were  first  seated  before  the  ^ 

monitor.  They  were  told  that  they  would  be  instructed  m  a  1 

technique  for  adjusting  artillery  fire  presently  used  in  the  -i 

Army,  and  that  they  would  be  tested  at  its  end.  They  were,  1 

however,  assured  that  the  test  results  would  reflect  on  tne  j 

svstem  thev  were  learr.inc  from  and  not  on  them..  They  were  J 


told,  in  addition,  that  since  the  system  was  a  prototype, 
its  proper  functioning  was  easily  disrupted,  and  that  they 
should  be  careful  to  follow  explicitly  all  directions  which 
appeared  on  the  monitor  screen.  They  were  then  told  that 
they  would  be  using  the  two  input  media  indicated  by  the 
cell  to  which  they  were  assigned,  one  for  each  half  of  the 
instruction  and  one  for  each  half  of  the  test.  They  were 
then  told  which  input  medium  to  begin  wTith  and  asked  to 
start  the  instruction. 

Content.  Every  subject  received  the  same  content  and  test. 
The  instruction  was  arranged  in  a 
Rule-Exam.ple-Practice-Feedback  sequence,  and  there  were 
three  rules  to  be  learned:  calculation  of  ar. 
Observer-Target  ( OT )  factor,  deviation  correction,  and  range 
correction.  For  each  rule,  the  importance  of  knowing  how  tc 
use  the  rule  was  explained;  then  the  rule  itself  was  giver, 
visually  with  some  audio  reinforcement  as  well.  Next,  one 
or  two  examples  were  given,  depending  on  the  concept;  and 
finally  four  or  five  practice  problems  with  feedback  were 
given,  again  depending  on  the  concept. 

When  all  three  rules  had  been  learned,  subjects  were 
given  five  simulated  binocular  views,  each  with  a  target  and 
exploding  artillery  round,  and  asked  to  correct  deviation 
and  range  so  that  the  next  shot  would  hit  the  target;  this 
required  use  of  all  three  rules.  Corrective  feedback  was 
provided  with  all  practice  problems  so  that  an  incorrect 
answer  would  elicit  yet  another  example  of  how  to  correctly 
solve  the  problem.  All  practice  problems  were  created  to 
reflect  the  entire  domain  of  range  correction  problems 
encountered  in  the  field  with  the  exception  of  corrections 
for  altitude  changes  of  a  target. 

After  this,  subjects  were  presented  with  a  fourteen 
item  test  where  all  items  were  identical  in  format  and 
skills  level  to  the  five  comprehensive  practice  items 
immediately  preceeding  them.  There  was,  however,  no 
feedback  of  any  type  given  for  the  test  items.  As  an  added 
precaution  against  untimed  study  of  any  items  a  title  header 
which  completely  covered  the  screen  was  inserted  between 
each  problem,  and  held  on  the  screen  for  approximately  five 
seconds.  Also,  the  monitor  screen  was  blanked  between  the 
seventh  and  eighth  items  to  prohibit  casual  study  of  ite- 
eight  while  changing  input  medium. 

Administration  of  Treatments.  The  order  in  which  input 
media  were  used  during  the  experiment  was  balanced  in  the 
following  manner.  Tr.e  choice  of  which  medium,  to  have  each 
subject  begin  with  was  first  made  by  the  flip  of  a  coin; 
after  that  it  was  alternated  for  each  subject.  Half  way 
through  the  experiment  each  subject  was  asked  to  change 
input  media.  At  the  beginning  of  the  test  every  other 


subject  was  asked  t  change  back  to  the  first  medium,  the 
choice  for  the  first  subject  again  being  made  by  the  flip  of 
a  coin;  the  regaining  subjects  continued  with  the  medium 
they  were  currently  using.  All  subjects  chanced  input 
medium  again  half  way  through  the  test. 

The  methods  of  simulating  the  touch-sensitive  TV 
screen  and  voice  input  system  were  as  follows.  For  the 
touch  panel,  a  strip  of  acetate  with  letters  representing 
appropriate  word  or  phrase  responses  printed  on  it  was  fixed 
vertically  to  the  left  edge  of  the  sreer.;  across  the  bottom 
of  the  screen  was  placed  a  similar  strip  printed  with  the 
numerals  0  through  9.  When  a  response  was  indicated, 
subjects  would  touch  the  letters  and  numbers  on  the  screen 
which  represented  their  answer,  and  as  they  touched  the 
screen  the  proctor  would  type  the  same  answer  on  the 
keyboard . 

For  the  voice  input  system,  subjects  simply  spoke 
their  responses  and  the  proctor  typed  them.  The  simulation 
was  further  enhanced  by  requiring  subjects  to  use  only  the 
words  and  phrases  designated  in  the  lessor,,  and  tc  signal  a 
carriage  return  by  some  word  of  their  choice  used 
consistently  throughout  the  lesson.  It  should  be  noted  that 
the  proctor  was  sufficiently  adept  at  typing  to  keep  up  with, 
most  student  responses,  so  that  his  typing  was  rarely  a 
factor  in  lengthening  the  response  time. 

The  dependent  variables  of  response  time  and  error 
rate  were  measured  with  a  quartz  chronograph  stopwatch,  but 
measurements  were  taken  only  during  the  test;  it  was  felt 
that  the  instruction  and  practice  should  provide  time  for 
subjects  to  become  accustomed  to  using  the  system, 
particularly  the  input  media.  For  each  test  item,  the 
proctor  measured  the  time  from  initial  presentation  of  the 
problem  to  final  entry  of  the  subject's  answer.  A.ll  screen 
erasures,  and  pauses  for  thought  were  included  in  the 
response  time  measurements;  this  was  not  thought  to  be  a 
problem  since  all  input  media  were  used  on  all  problems,  and 
the  more  difficult  items  which  required  more  rumination  were 
responded  to  via  every  medium.,  thus  distributing  their 
effect  evenly  over  all  measurements.  An  error  was  defined 
to  be  an  incorrect  answer  entered  by  a  subject.  Screen 
erasures  were  not  counted  as  enors  since  they  were  net 
entered . 

After  they  completed  the  test,  subjects  were  asked 
which  of  the  two  input  media  they  preferred.  They  were  then 
encouraged  to  explain  their  choice.  This  information  was 
recorded  by  the  proctor. 


K-j  -  n  1 1  s 

Homogeneity  of  Subjects  Within  Cells.  A  comparison  of 
keypad  response  times  and  accuracy  rates  among  cells  served 
as  a  check  on  the  overall  homogeneity  of  the  subjects  who 
had  been  assigned  to  the  different  cells.  Significant 
difference  between  cells  in  keypad  performance  (the  input 
medium  common  to  all  cells)  would  indicate  a  cell-by-medium, 
interaction.  Thus,  analysis  of  variance  was  performed  or. 
the  mean  keypad  response  from  each  of  the  three  cells.  As 
is  illustrated  in  Table  D-2  below,  the  F  (df=l,53)  value  of 
the  response  time  means  was  0.34  and  that  of  the  accuracy 
rate  means  was  0.49;  this  means  there  were  no  significant 
differences  between  cells  for  either  response  times  or 
accuracy  rate.  These  results  were  taken  as  evidence  that 
there  was  nothing  about  the  cells  which  constituted  a 
confounded  variable  in  the  analysis.  Specifically,  there 
was  no  evideence  from,  this  data  that  the  assignment  of  R07C 
students  to  cell  1  and  Orem  High  School  students 
predominantly  to  cell  2  confounded  the  results  in  this 
analysis . 

Response  Times.  Analysis  of  variance  was  performed  on  the 
mean  response  times  for  the  input  media,  and  the  results 
were  as  follows:  An  F  (df=3,50)  statistic  of  25.46 
indicated  significant  differences  among  the  means,  and  a 
Newman-Kuels  multiple  comparisons  test  showed  that  1)  the 
keyboard  response  time  mean  was  significantly  longer  than 
all  the  others, and  2)  the  voice  input  system  mean  was 
significantly  shorter  than  all  the  others.  The  keypad  an: 
touch  panel  showed  no  significant  difference.  These  results 
are  summarized  in  Table  D-3. 


Accuracy  Rates.  Analysis  of  variance  yielded  an  F  (df=3,50) 
value  of  1.18,  indicating  non-significant  differences  in 
this  set  of  data.  Voice  input  produced  the  most  errors, 
ever,  when  filtered  through  a  human  listener  who  could 
ingnore  noise  and  interpret  different  accents  an: 
inflections.  This  difference  was  not  significant  in  the 
experiment,  but  it  should  be  noted  that  with  a  mechanical 
voice  input  system.,  the  error  rate  could  easily  be  much 
higher.  Thus  these  data  should  not  be  taken  to  mean  that 
any  voice  input  system  would  produce  as  few  response  errors 
as  a  keypad  when  used  with  an  interactive,  job  training 
videodisc.  See  table  D-4  for  a  summary  of  this  data. 

Preference.  Preferences  were  determined  in  this  study  by 
asking  each  subject  which  of  the  pair  of  input  media  user, 
was  preferred.  Thus  all  preferences  were  determined  by 
comparing  the  keyboard,  touch  panel,  or  voice  input  syster 
with  the  keypad.  However,  preferences  were  approximately 
equal  for  all  media  except  the  keyboard,  which  was  preferred 
by  only  two  people  out  of  twenty-five  in  that  cell.  Since 
the  binary  distributions  formed  by  these  ratings  were 
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RESPONSE  TIMES  AND  CORRECT  RESPONSE  RATES 
FOR  KEYPAD  USE  BY  CELL 
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MEAN  RESPONSE  TIMES  FOR  EACH  INPUT  MEDIUM 
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MEAN  ACCURACY  RATE  FOR  EACH  INPUT  MEDIUM 


INPUT 

MEDIUM 

CORRECT 
RESP.  RATE  ! 

STANDARD 

DEVIATION 

)  F-TEST 

1  MS  F 

Keyboard 

0 .886 

0.319  i 

MST 

0.1127 

1 .18 

Keypad 

0.910 

0.2S6 

MSE 

i 

0.0957 

Touch  Panel 

0.S88 

0.317 

1 

i 

Voice  Input 

0 . 84  S 

0.361 

I 

! 

: 

Table  D"  5 


COMPARATIVE  PREFERENCE  OF  KEYPAD  TO  EACH  OTHER 

INPUT  MEDIUM 


MED I UM 
COMPARED 

TO  KEYPAD 

7c  IV  HO 
PREFERRED 
KEYPAD 

7  WHO 
PREFERRED 

1  OTHER  MEDIUM 

Z-TEST 

OF  HYPOTHESIS 
THAT  PREFERENCES 
ARE  EQUAL 

Keyboard 

80.0 

j  20.0 

4.200* 

Touch  Panel 

50.0 

!  50.0 

0.000 

Voice  Input 

46 . 7 

'  53.3 

0.256 

approximately  normal,  a  z-test  was  performed  to  test  these 
differences  in  preference  in  each  cell.  The  great  disparity 
between  keyboard  and  keypad  preferences  (cell  1)  was 
significant,  with  a  z  value  of  4.20;  preferences  in  cells  2 
and  3  showed  no  significant  differences.  These  findings  are 
summarized  in  Table  D-5. 

In  summary  then,  the  simulated  voice  input  system 
yielded  the  shortest  response  times,  followed  by  the  keypad 
and  touch  panel,  with  the  keyboard  yielding  the  longest 
response  times.  There  was  no  difference  between  the  four 
media  in  accuracy  rate,  but  this  finding  is  not  applicable 
to  voice  input  with  mechanical  systems  in  general.  Each 
system  has  its  own  inherent  error  rate  due  to  factors  not  a 
part  of  this  experiment.  The  only  significant  difference  of 
preference  between  media  was  the  low  ratings  returned  on  the 
keyboard . 


DISCUSSION 

One  element  of  the  experiment  which  affected  the 
results  to  an  unknown  degree  is  the  fact  that  two  of  the 
input  media  were  simulated.  For  instance,  subjects 
occasionally  made  comments  like  this:  "I’d  have  liked  the 
touch  panel  more  if  it  were  real."  Thus,  it  is  unwarranted 
to  assume  that  the  simulations  were  totally  effective; 
there  was  an  artificial  atmosphere  about  the  touch  panel  and 
voice  input. 

As  an  adjunct  to  this  study,  the  project  tear 
investigated  a  number  of  voice  input  systems,  including  the 
Heuristics,  Interstate,  and  Threshold  systems.  Prices  were 
obtained  for  the  cost  model.  The  error  rates  on  all  system, 
but  the  expensive  Threshold  system  appeared  to  be  much 
higher  than  the  15%  observed  in  this  simulation. 

An  aspect  of  the  experiment  closely  related  to  that 
above  is  the  artificial  ease  with  which  the  voice  input 
system  operated.  Actual  voice  input  systems  usually  require 
training,  both  of  the  user  and  the  system,  where  the 
interactions  of  voice  and  word  idiosyncrasies  for  each 
individual  user  are  determined  and  stored  in  the  system's 
memory.  Even  after  this  extensive  training  the  "hit  rate," 
or  percentage  of  user  input  words  which  are  correctly 
interpreted  by  the  system,  is  not  perfect.  Added  to  this 
inaccuracy  is  the  complication  that  a  voice  input  system 
seeks  to  interpret  everything  it  receives  as  a  word  in  its 
limited  vocabulary;  this  means  that  a  person  thinking  out 
loud  to  himself  must  either  turn  off  the  microphone  of  the 
voice  input  system,  or  risk  having  some  murmurings  accepted 
as  input  if  they  are  close  to  a  stored  utterance. 


None  of  these  weaknesses  of  a  voice  input  system 
were  simulated  in  the  experiment:  The  keyboard  operator 
never  entered  murinurings  as  a  bona  fide  response;  there  was 
no  training  other  than  simply  telling  subjects  to  mark  the 
end  of  every  response  with  the  same  word,  and  the  hit  rate 
on  the  simulated  system  was  much  more  nearly  perfect  than 
that  which  a  real  system  could  have  generated.  Because  of 
this  artificially  efficient  input  system,  it  is  reasonable 
to  believe  the  response  times  it  yielded  are  artificially 
small. 

It  should  "be  noted,  however,  that  the  keyboard  and 
keypad  media  were  not  simulations.  Also,  the 
characteristics  of  the  simulated  touch  panel,  while 
minimizing  the  otherwise  real  danger  of  errors  due  to 
parallax  (and  generating  some  embarrassment  in  subjects  who 
used  it),  nevertheless  was  a  relatively  accurate 
reproduction  of  an  actual  instrument.  And  lastly,  the  voice 
input  simulation,  for  all  its  shortcomings,  still  reproduced 
the  grosser  charactericst ics  of  a  real  system  fairly  well. 
For  these  reasons  the  results  of  this  experiment  can  be 
applied  to  some  degree  to  input  media  in  the  real  world.  It 
can,  for  instance,  be  safely  concluded  that,  with  high 
quality  equipment  and  proper  training,  users  of  voice  input 
systems  can  approach  the  speed  of  response  exhibited  in  the 
experiment;  it  can  also  be  concluded  that  the  conventional 
keyboard  input  medium  is,  for  most  people,  both  sufficiently 
difficult  and  irritating  to  suggest  the  use  of  a  different 
input  medium  when  circumstances  permit. 

However,  again  practical  considerations  should  not 
be  excluded.  There  is  the  matter  of  expense.  Keypads  are 
by  far  the  least  expensive  of  the  input  media  tested, 
available  in  large  quantities  for  less  than  $10  per  unit. 
Next  in  price  are  keyboards,  currently  selling  for  $50  to 
$150  per  unit  for  large  orders.  Touch  panels  are  higher 
still  in  price,  starting  at  $500  and  quickly  escalating  from 
there,  and  most  expensive  of  all  are  voice  input  systems, 
priced  from  $3000  to  $18,000.  With  these  ballpark  figures 
in  mind  it  should  be  apparent  that  the  quicker  response 
times  of  voice  input  systems  are  dearly  bought  and  that  the 
3  to  7  seconds  and  the  freeing  of  the  user's  hands  for  other 
tasks  gained  by  their  use  must  be  fairly  important  to 
justify  the  expense.  On  the  other  hand,  though,  these 
figures  serve  to  reinforce  the  commonly  observed  negative 
response  to  conventional  keyboards  for  training  purposes, 
since  the  less  expensive  keypad  can  often  suffice. 

Finally,  the  purpose  of  a  system  should  have  a 
substantial  effect  on  the  choice  of  input  media  attached  to 
it.  For  instance,  despite  the  long  response  times  and  low 
preference  ratings  associated  with  the  keyboard,  it  is  the 
only  input  medium  of  the  four  tested  which  would  adequately 
serve  purposes  requiring  input  of  free  text.  In  another 
situation-one  requiring  a  relatively  limited  number  of 


responses  and  undivided  attention  to  a  photoelectronic 
displny--a  touch  panel  would  serve  best,  since  users  could 
respond  without  diverting  attention  to  extraneous  devices. 
Touch  panels  might  also  be  useful  for  applications  where 
compactness  and  portability  are  critical,  since  they  are  not 
physically  separate  from  the  display.  A  voice  input  system 
could  prove  cost  effective  in  situations  where  quick 
response  times  are  important  or  where  the  user's  hands  are 
occupied  with  different  duties.  The  keypad  could  be 
considered  the  workhorse  input  system,  being  suited  for 
general  purpose,  limited  response  applications. 


